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(54) Enhanced surgical device tracking system 

(57) A surgical device tracking system for visualiza- 
tion of the position and orientation of a surgical device 
during a surgical procedure, the system comprising a 
surgical device comprising at least one sensor, an input 
inst rumen t, adapted to communicate with one or more 
sensor on the sujgir^^Yice^for generating position 
and orientatiorx^fala ^ proces^ng system for acquirin g 

and inteipretingTF^ataanT generating a plurality of 
j — 



outputs , and a display system for viewing at least one 
of the generated outputs. The processing system being 
capable of receiving and analyzing a descriptive input 
of the surgical device incorporating the sensor, and de- 
termining physical parameters relative to a tissue struc- 
ture and the relative position, orientation and motion of 
the surgical device therein, the processing system also 
acquiring treatment location data. - 
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Description 



[0001] This invention relates to the field of computer based viewing hardware with fluoroscopic tools for eardac 
surgery, and more particularly to viewing devices for myocardial revascularization. 

s [0002] Heart disease is a significant health problem which has been the subject of substantial medical study. Bypass 
surgery has become commonplace; yet such surgery may be unavailable to many patients, either because of the nature 
of the occlusions or the physical condition of the patient. One promising alternative technique for treating such cases 
is known as transmyocardial revascularization (TMR). Although this technique was considered as early as the work of 
Dr C Beck in The Development of a New Blood Supply to the Heart By Operation'. Annals of Surgery. Vol. 1 02, No. 

io 5 (11/35) pp 801-81 3. the method was not extensively studied until the work of Dr. M. Mirhoseini and M. Cayton, an 
example of which is found in "Users in Cardiothoracic Surgery' in lasers in General Surgery. (Williams and Williams; 

1989), pp. 216-223. - . . 

[0003] Myocardial revascularization systems used by interventional cardiologists include a percutaneous translumi- 
nal myocardial revascularization (PMR) instrument that is a catheter and tissue removal energy delivery system that 

is creates channels partially into the myocardium from inside the left ventricle. In the PMR procedure, an interventional 
cardiologist performs a cardiac catheterization procedure using a catheter with an internal optical fiber which is inserted 
into the femoral artery at the groin and advanced through the aortic arch into the left ventricle of the heart. Once in the 
ventricle, the catheter is guided to the endocardium where the device creates pathways through the endocardium and 
a portion of the myocardium. . • • ' • . 

20 [0004] A PMR procedure generally requires a physician to use a hand-held device which guides a mechanical cutting 
device or olher suitable energy delivery device. For example, an energy delivery device may include a laser energy 
device having one or more optical fibers through which laser energy is directed. Mechanical, laser energy, or other 
suitable energy cuts or vaporizes heart muscle tissue immediately in front of the distal end of the device. Further, 
varying penetration depths of the energy delivery device within the myocardial tissue are possible. Clinical tests have 

25 demonstrated that revascularization channels/pathways, which generally communicate with the ventricle, facilitate 
revascularization of the heart muscle. . 
r0O05] U S Patent No. 5.876.373 to Giba et al., entitled 'Steerable Catheter,' filed April 4, 1 997 and issued March 
2 1 999 and EPO Publication No. EP 0 868 923 A2 entitled "Steerable Catheter with Tip Alignment and Surface Contact 
Detector' published March 31. 1999. are incorporated herein by reference in their entirety. These applications teach 

30 steerable catheters and methods of use. particularly adapted for PMR use. The distal portion of the catheters are 
deflectable Rotation of the catheters, therefore, such as within the left ventricle during a PMR procedure, will allow 
treatment of essentially any surface area within the ventricle. The catheters have a relative movement compensation 
mechanism for maintaining positioning between the distal portion of the catheter and a functional device deposed 
therein. The deflectable portion of the catheter is non-deformable. oe/oc , eo 

35 r0O06] Another approach to catheter construction for PMR is described in International Publication WO 96/35469. 
entitled "System for Treating or Diagnosing Heart Tissue." International Application No. PCTAJS96/06700, filed May 
9 1 996 by Kesten et al and WO 98/39045. entitled "Catheter with Three Sections of Different Flexfoiiities." International 
Application No PCTAJS98/04484, filed Mar. 6, 1998 by Javier et al.. are also hereby incorporated by reference in their 
entirety In these systems, an aligning catheter, shaped to extend along the long axis of the left ventricle, guides a laser 

40 catheter to various and predetermined individual points within the left ventricle. The intraluminal catheter has an elon- 
gated tubular shaft with proximal, intermediate, and distal shaft sections for positioning a therapeutic or diagnostic 
device within a patient's body region, such as a heart chamber. The intermediate shaft section has greater flexibility 
than the proximal or distal shaft sections, and is preferably of sufficient flexibility to easily assume the curvature of the 
patient's aortic arch, and reduce the force of contact between the distal end of ihe catheter and tissue defining the 
as patient" s body region to thereby reduce restriction on the rotation of the catheter. The flexible intermediate shaft section 
is preferably of a length to occupy a significant portion of the arctic arch, and the catheter overall length is preferably 
sufficient to have a catheter proximal extremity extending out of the patient and a distal extremity extending at least 
into an aortic passageway adjacent the patient's left ventricle. In certain embodiments, the distal section of a guidmg 
or first delivery catheter, is provided with a double bend, or other predetermined geometry and dimension, to facilitate 
so a perpendicular approach by a laser or other energy delivery device to the endocardial surface of the left ventncle. 
[0007] Fluoroscopy is used during a PMR procedure to locate the distal tip of an energy delivery device inside the 
heart to ensure proper channel formation and prevent excessive penetration of the myocardial tissue of the heart. 
Typically dye is injected into the chambers of the heart to provide contrast and enhance the fluoroscope image. There 
are problems associated with the use of fluoroscopy. The dye usually dissipates before all the revascularization chan- 
ss nels and/or pathways of a PMR procedure can be created. Moreover, since most current fluoroscopy imaging systems 
are two-dimensional imaging systems, during a PMR procedure the cardiologist must continuously monitor two per- 
pendicular planar images of a heart to more accurately determine the distal tip position of an energy delivery device 
in a three-dimensional perspective. 
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[0008] Additionally, tracking channels previously created during the procedure is another problem since the screen 
may not readily show locations of these previously created channels. Utilizing additional or excessive radiation to help 
track the distal tip ot the energy delivery device or track previously created channels while using a fluoroscopic system 
poses radiation hazards to patient and operating room personnel. 

5 [0009] U.S. patent 5,369,678 to Chiu, entitled "Method for tracking a catheter probe during a fluoroscopic procedure, 
• teaches a fluoroscopy system for monitoring the location of a catheter inside a body during balloon angioplasty or 
laser ablation for percutaneous interventional procedures. Chiu teaches a method for determining catheter tip location 
from fluoroscopic images using digital imaging processing techniques that confine full X-ray dosage to a central area, 
compensating for the reduced X-ray dosage in the peripheral areas by computer imaging enhancement but does not 

10 solve the problems currently associated with the use of fluoroscopy for guidance and visual marking in PMR and other 
intracardiac catheter-based procedures. 

[0010] It is desirable to have apparatus and methods that use integrated hardware of a processing system, video 
capture, image display and manipulation and angular feedback from the fluoroscopy device to assist the cardiologist 
during the PMR procedure. There is a further need for apparatus and method that solves the problems associated with 
is the use of fluoroscopy for guidance and visual marking in PMR and other intracardiac catheter-based procedures. 
Furthermore, there is a need to reduce the complexity of positioning such catheters and estimating the precise position 
inside the left ventricle to form channels during myocardial revascularization. 

[001 1] To carry cut a surgical procedure, with the use of a surgical device entering and moving within a human body 
it is often necessary to ascertain the position and orientation of the distal portion of the surgical device to ensure proper 

20 placement of the distal portion during application of a desired therapy. 

[0012] The present invention involves the tracking of an surgical device within a human body. Various input instru- 
ments provide position and orientation information with respect to the surgical device and pass this information along 
to a processing unit which then interprets the information through the use of certain algorithms. The information is then 
merged with additional data acquired and used as a basis for generating at least one output descriptive of the position 

2S and orientation of the surgical device. 

[001 3] Therefore, a first object of the present invention is to replace the current manual channel mapping technique 
with a computerized, video-based mapping technique having improved accuracy. 

[0014] A further object of the present invention is to decrease the degree to which the fluoroscopy related PMR 
procedure is dependent upon additional visualization capability or means, thus allowing the user to remain predomi- 
30 nantly in a single plane projection throughout most of the procedure. 

[0015] Another object of the present invention is to provide for a more accurate depictbn of a surgical device within 
the left ventricle of a heart by gathering data from different sources and then correlating the gathered data with a 
common point of reference, generating various outputs from the correlated data 

[0016] Still another object of the present invention is to provide a system for alleviating a surgeon from performing 

35 complex interpretations of data perceived during a surgical procedure. 

[0017] Yet another object of the present invention is to provide a system for allowing a surgeon to create or dictate 
a depiction of a surgical procedure, assisting the surgeon during a specific task as part of the surgical procedure. 
[001 8] Another object of the present invention is to assist a surgeon in the placement of a surgical device at a target 
tissue area during a surgical procedure, the surgeon being able to view a depiction of the surgical device in a live fluoro 

40 image. 

[0019] Still another object of the present invention is to assist a surgeon in the placement of a surgical device at a 
target tissue area during a surgical procedure, the assistance being provided in a final indication of a target tissue site 
in a generated depiction based on an initial input from the surgeon descriptive of the target tissue site location in another 
depictbn. 

45 [0020] Numerous other advantages and features of the present invention will become readily apparent from the 
f olbwing detailed description of the invention and the embodiments thereof, from the claims and from the accompanying 
drawings. 

In the drawings: 

50 

[0021] Fig. 1 is a block diagram of an enhanced tracking system in accordance with the present invention. 
[0022] Fig. 2A is a perspective view of a geometric representation of the left ventricle portion of a heart. 
[0023] Fig. 2B is a right anterior oblique projectfon view of an energy delivery device within the left ventricle of a 
heart in accordance with the present invention. 
55 [0024] Fig. 2C is a left anterior oblique projection view of an energy delivery device within the left ventricle of a heart 
in accordance with the present invention. 
[0025] Fig. 3A is a right anterior oblique project view of a heart. 
[0026] Fig. 3B is a left anterbr oblique projection view of a heart. 
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[0027] Fig. 4A is an elevation view of a first energy delivery device used in accordance with the present invention. 
[0028] Fig. 4B are representative top, orthogonal and elevation views of an exemplary radio opaque marker band 
for use on the distal tip of an energy delivery device in accordance with the present invention. 
[0029] Fig. 4C is a representative RAO-30 projection view of an intraventricular energy delivery device in the left 
ventricle in accordance with the present invention. 

[0030] Fig. 4D is another representative RAO-30 projection view of an intraventricular energy delivery device in the 
left ventricle in accordance with the present invention. 

[0031] Fig. 4E is a representative elevation view of the distal end of a second energy delivery device in accordance 
with the present invention. . 
[00321 Fig. 4F is a representative elevation view of the partially deflected, apicalfy oriented distal end of a second 
energy delivery device in accordance with the present invention. 
[0033] Fig. 4G is a representative elevation view of the partially deflected, laterally oriented distal end of a second 
energy delivery device in accordance with the present invention. 

[0034] Fig. 4H is a representative elevation view of a partially deflected third energy delivery device m accordance 
is with the present invention. 

[0035] Fig. 41 is a RAO and LAO projection view of the distal end of another energy delivery device within the left 

ventricle of a heart. , ,. 

[0036] Fig 4J is another representative RAO and LAO projection view of the distal end of another energy delivery 
device within the left ventricle of a heart. Fig. 5A is a representative RAO-30 projection view of another energy delivery 
20 device within the left ventricle of a heart. ; 

[0037] Fig. 5B is a representative LAO-60 projection view of another energy delivery device wrthin the left ventncle 

powTW 6 is a representative RAO-30 projection view of the distal end tip of an energy delivery device directed 
perpendicularly towards internal surface areas of the left ventricle. 
25 [0039] Fig 7 is a series of representative RAO-30 projection views of a series of channels formed by the distal end 
tip of an energy delivery device directed perpendicularly towards internal surface areas of the left ventncle. 
[0040] Fig. 8 is a series of representative LAO-60 projection views of a series of channels formed by the distal end 
tip of an energy delivery device directed perpendicularly towards internal surface areas of the left ventricle. 
[0041] Fig. 9 is a set of flowc harts definin g a preferred method performed in accordance with the present invention. 
30 [0042] Fig. 1 0 is an exemplary view of an output generated in accordance with the present invention. 

[0043] It will be understood while numerous preferred embodiments of the present invention are presented herein, 
numerous of the individual elements and functional aspects of the embodiments are similar. Therefore, it will be un- 
derstood that structural elements of the numerous apparatus disclosed herein having similar or identical function may 
have like reference numerals associated therewith. 

[0044] Additionally it should be generally understood that the following discussion, while directed to a PMR procedure 
specifically, would apply to any surgical procedure involving the tracking of surgical devices, including position and 
orientation, within a body, or near or wrthin a target tissue site. 
[0045] Now referring to Figs. 1, 2A, 2B, 3A, 4A, 6, 7, and 8, a PMR procedure performed in accordance with the 
present invention can be more readily understood. Revascularization channels are formed using energy delivery sys- 
40 terns which apply energy to specific target tissue sites within the left ventricle of a heart, ablating or otherwise causing 
an injury at the site. The energy is transmitted from a point external to a patient's body, to the target tissue site, by an 
energy delivery device. Such energy delivery systems include, but are not limited to, the single use, or use in combi- 
nation of one or more of the following energy sources: laser, radio frequency (RF), ultrasound, fluid, thermal, mechan- 
ical systems including piercing, coring, and other systems requiring transnational or rotational movement, or any other 
as system which incorporates an energy source and transmits energy through an energy delivery device to a target tissue. 
The specific configuration of the energy delivery device is dependent on the energy being transmitted. 
[0046] It is also contemplated that the present invention can be used in conjunction with energy delivery devices 
involved with other medical therapies or additional tools including one or more functional devices. For example, an 
energy delivery device may comprise a drug delivery device where the operational aspects of the drug delivery, including 
so the timing and volume of a delivered dosage with respect to energy delivery, are controlled by a processing system, 
in accordance with the invention described herein. Drug delivery devices, by way of example only, include those dis- 
closed in International Publication No. WO 99/49773, entitled "DEUVERY CATHETER SYSTEM FOR HEART CHAM- 
BER ' published October 7, 1999, U. S. Patent 5,999,678, entitled -LASER ASSISTED DRUG DELIVERY," filed De- 
cember 17, 1996 and issued December 7, 1999, and U.S. Patent 5,925,012, entitled -LASER ASSISTED DRUG DE- 
55 LIVERY, " filed December 27, 1 996 and issued July 20, 1 999, ail three incorporated herein by reference. 

[0047] ' With specific reference to Fig. 4A, one type of energy delivery device which may be used in accordance with 
the present invention is shown in the form of a laser catheter 500. Catheter 500 is a coaxial catheter system as taught 
by Kesten et al (International Application No. PCT/US96/06700) and includes an aligning catheter 502 and a laser 
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catheter 504 having a preformed distal tip 506. Laser catheter 504 is rotatably and slidably disposed within the aligning 
catheter 502. At least one optical fiber 508 exits the catheter 504 at the distal tip 506 opening and is rotatably and 
slidably disposed within the laser catheter 504. A lens portion 510 is operably attached to the distal tip of the optical 
fiber or fiber bundle 508 focusing laser energy towards a target tissue site. Attached to the lens portion 51 0 is a cylindrical 

s radio opaque marker 512. As is discussed in more detail below, additional markers attached to catheter 500 may be 
used to help better determine the position and orientation of catheter 500 within a chamber of the heart. 
[0048] During a PMR procedure, catheter 500 is inserted into, for example, the femoral artery at the groin and ad- 
vanced through the vasculature toward the heart, the distal portion of the catheter 500 passing through the aortic arch 
and into the left ventricle of the heart Once in the ventricle, the catheter 500 is guided to the endocardium where the 

io distal tip 51 0 of the catheter 500 transmits energy from a source to the target tissue, the transmitted energy creating 
pathways through the endocardium and a portion of the myocardium. Fig. 6 depicts catheter 500 in use during a PMR 
procedure showing a small representation of angular combinations' achievable providing a generally perpendicular 
approach to a specific target tissue site. 

[0049] As the catheter 500 is advanced toward and then within the left ventricle of the heart and directed toward a 
75 target tissue site, the radio opaque marker is viewable on the video display 116 of the fluoroscopy system 118. The 
live fluoro image on video display 116 assists the surgeon in advancing or navigating the catheter 500 toward the target 
tissue site, as well as positioning the distal tip 51 0 at the site. 

[0050] With reference to Fig. 4E another energy delivery device, catheter 400, is shown. Catheter 400 has a main 
shaft portion 402, and a distal end 410 comprising a distal tip radio opaque marker 412 similar to the marker 512 of 

20 catheter 500. Catheter 400 also comprises a plurality of thin circular markers 414 spaced a predetermined distance 
from each other along a distal portion 416 of catheter 400 defined by the distal end of the main shaft 402 and the 
marker 412. The distal portion 416 of catheter 400 also comprises a deflection mechanism which deflects the distal 
portion, the central axis of an opening at the distal end 41 0 and a central axis of the main shaft 402, where the shaft 
402 interfaces with the most proximal marker 414, forming an angle therebetween. Alternatively, as shown in Fig. 4G, 

25 the markers 41 4A can be constructed to have similar dimensions as marker 41 2, each marker 41 4A being a predeter- 
mined distance from one another. 

[0051] For purposes of discussion, energy delivery device 300 can be any energy delivery device having the common 
attributes of a distal tip 310 comprising at least one radio opaque marker and at least one lumen. Thus, energy delivery 
device 300 can be catheter 400, catheter 500, or any other device similar in shape used as or in combination with 
30 . surgical tools during a surgical procedure, and having a structure similar to device 300 as described immediately above. 
[0052] Now with specific reference to Fig. 1 , the guiding of an energy delivery device from the femora! artery to the 
left ventricle can be better understood. A fluoroscopy system 118, shown in dashed, includes a fluoroscope 110 and 
at least one video display 116. Fluoroscope 110 is a device well known in the art, which includes an angle sensor 112 
and a fluoro video source 114. 

35 [0053] As in other systems, fluoroscope 11 0 further includes an X-ray source and an opposing image detector (not 
shown). Typically, during use, a subject is placed between the X-ray source and the image detector. After the X-ray 
source is activated, X-rays detected by the image detector define an image which is then encoded into a video signal. 
The encoded video signal is then provided by the fluoroscope 110 as an output, as part of fluoro video source 114. 
During a PMR procedure, the X-ray source and opposing image detector are moved to provide views of the subject 
40 from different perspectives, each perspective being defined by a plane having a specific orientation with respect to the 
subject. The Fluoroscope 110 can be a single plane or a bi-plane unit, the single plane unit being able to provide a 
single image with respect to a single orientation plane while the bi-plane unit is able to simultaneously provide two 
separate images", each image corresponding to a separate orientation plane. A video signal from the fluoro video source 
114 to be displayed on video display 116 is typically referred to as live fluoro since the video signal represents real- 
ms time views of the subject. 

[0054] It should be apparent, given a bi-plane fluoroscope 1 1 0, that the fluoroscopy system 1 1 8 may include a second 
video display 1 1 6a (not shown), where a first image corresponding to a first orientation plane of the subject is displayed 
on the first video display and a second image corresponding to a second orientation plane of the subject is displayed 
on the second video display. Alternatively, where the video display 116 is of sufficient size, both images may be dis- 
so played on the single video display 11 6. 

[0055] U.S. Patent Application 09/107,843, entitled "Intracorporeai Device with Radiopaque Marker - , filed by 
Rosenthal et al. on June 30, 1 998, is incorporated herein by reference in its entirety. This application teaches an energy 
delivery device compatible with the present invention in the form of a catheter with an elongated shaft having at least 
one asymmetric radio opaque marker disposed upon or within the distal end thereof. The radio opaque marker enables 
55 the user to distinguish orientation of the distal end of the device using a fluoroscopy system. 

[0056] Now referring to Figs. 2A and 3, a geometrically depiction of the general structure of the left ventricle of a 
heart, generally indicating the left ventricular planar surfaces and the associated coronary vasculature is shown. For 
example, the anterior planar surface is generally defined by the left anterior descending (LAD) coronary artery. As is 
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shown in Fig. 3A, the LAD coronary artery generally defines the anterior surface and, at its most distal end, the apical 
surface of the left ventricle while the PDA of the right coronary artery (RCA) defines the inferior surface of the left 
ventricle. As is shown iri Fig. 3B, the right coronary artery (RCA) and the circumflex (CFX) of the left coronary artery 
define the septal and lateral surfaces of the heart, respectively. 
5 Also shown is the posterior descending artery (PDA) of the right coronary artery (RCA). Figs. 2B and 2C are repre- 
sentative right anterior oblique (RAO) and left anterior oblique (LAO) views of an energy delivery device within the left 
ventricle of the heart of Fig. 2A, respectively. 

[0057] While the views of Figs. 2B and 2C are referred to as RAO and LAO views, respectively, more specifically, 
the view of Fig. 2B is referred to as RAO-30 since the view is 30° from vertical, and the view of 2C is referred to as 
io LAO-60 since the view is 60° from vertical. For simplicity, hereinafter RAO refers to RAO-30 and LAO refers to LAO- 
BO, unless stated otherwise. 

[0058] As is shown in Figs. 2A and 2B, the RAO view is generally parallel to the longitudinal axis of the left ventricle, 
generally referred to as the interventricular plane. As shown in Figs. 2A and 2C, the LAO view is generally parallel to 
the minor axis of the left ventricle, generally referred to as the atrioventricular plane. With reference also to Figs. 3A 

is and 3B, the relationship between the interventricular and atrioventricular planes and the cardiac vasculature of the left 
ventricle can be better understood. Fig. 3A is a representative RAO view generally parallel to the interventricular plane 
and, thus, perpendicular to the atrioventricular plane. Now with reference to Figs. 7 and 8, two illustrative revascular- 
ization channel creation techniques are shown. Fig. 7 generally depicts an RAO view of the heart with channels being 
formed with the use of an energy delivery device similar to catheter 500. Starting from a point more near the apex of 

20 the heart a first channel 1 is created as shown in Fig. 7 A. The laser catheter 504 is then retracted and a second channel 
2 is formed as shown in Fig. 7B. This process is repeated to create channels 3 and 4 in Figs. 7C and 7D, respectively. 
[0059] Fig. 8 depicts a second procedure utilizing the features of catheter 500. After a first channel 1 is created as 
shown in Fig. 8A, the laser catheter 504 is rotated within aligning catheter 502 to reposition the distal tip 51 0 to a new 
target tissue site 2, as shown in Fig. 8B. After channel 2 is created the laser catheter is once again rotated to reposition 

2S distal tip 51 0 and a third channel 3 is created as shown in Fig. BC. 

[0060] Generally, the present invention involves the use of a processing system to track and provide" a representative 
output of the relative position and orientation of a surgical device, such as an energy delivery device, with respect to 
its surrounding environment and other data acquired during a surgical procedure, such as a PMR procedure. Tracking 
of the surgical device is important since it allows a surgeon to associate events occurring during the surgical procedure 

30 with respect to the position and orientation of the surgical device. For example, during a PMR procedure, tracking of 
the distal tip of an energy delivery device allows for the mapping of created revascularization channels, ensuring that 
such channels are accurately created at specific target tissue sites and are separated a predetermined distance. Ad- 
ditionally, tracking, in accordance with the present invention, allows a surgeon to initially select a target tissue site from 
a display, at least partially created by algorithms executed by a processing system, and then navigate to and align the 

35 distal tip of the energy delivery device with the selected target tissue site. 

[0061] An energy delivery device used in accordance with the present invention is adapted to accept one or more 
sensors specifically designed and placed on the energy delivery device in a known arrangement. The term sensor as 
used herein is meant to mean any device that receives and responds to a signal or stimulus, either actively or passively. 
A radio opaque marker, when used with a fluoroscopy system, is deemed to be within the definition of a sensor as 

40 used herein. Additionally, passive devices such as magnets, and transducers such as accelerometers, pressure sens- 
ing devices, and ultrasound devices, are also deemed to fall within the scope of the term sensor as used herein. 
[0062] As stated just above, these sensors can be active or passive devices. For example, as mentioned above, one 
such sensor may be a specifically designed radio opaque marker which, when subjected to X-rays from a fluoroscopy 
system, absorb such X-rays providing contrast between the marker and its surrounding environment, allowing the 

45 marker structure to become visible when displayed on an associated fluoro display. These markers can then be ana- 
lyzed to determine the position and orientation of the energy delivery device, to which the marker is attached. 
[0063] While a radio opaque marker is preferably used at the catheter tip to albw for aspect perspective, no specific 
design of radio opaque marker is preferred as long as the specific dimensions defining the marker are provided to the 
processing system. The particular design aspects of the markers, on the other hand, are directed to gaining from a 

so single view some or all of the information that might have been obtained from a pair of orthogonal views. This is 
accomplished first by using radio opaque elements designed to present additional information regarding the position 
and orientation of the distal tip of an energy delivery device when viewed from a single fluoroscopic projection, and 
then combining such radio opaque elements with additional information acquired or generated by the processing sys- 
tem, as is discussed in more detail below. 

55 [0064] A magnet is another example of a passive sensor which may be used in accordance with the present invention. 
In contrast, a sensor can be an active device which transmits a signal in response to receiving or otherwise directing 
a signal in the direction of the element 

[0065] Various input instruments are used to track the elements, providing the processing system with position and 
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orientation data in one ot several different formats. The data is processed by the processing system and I prov.ded m 
a rn^^bteTorm tothe surgeon performing the surgical procedure. Output formats include two and three^menstona. 
ou^ut depictions of channel formation and computer generated graphs representations erf drflerent views * *e 
ventricle showing the energy delivery device therein, both being able to be incorporated wrth the hve fluoroscope .mages 
as een by the surgeon performing the procedure, as a video overlay which is combined with the '^ fluoroscope 
images or as a separate image in close proximity to the fluoroscope images allowmg the surgeon to eas.ly v,ew both 

S^ReS now to Fig. 1 , a general Embodiment of an enhanced tracking system h accordance with ^ 
Son can be more readily understood. An enhanced tracking system 100 includes an input mstrument 108, a CPU 
102, and a video display system 106. To assist a surgeon during a PMR procedure the fluoroscopy system 118. as 
inttialtv described above, is typically utilized. ...... Y 

o5 Z input instnimem 108 provides the CPU 102 with raw data with respect to the position anc onentetoi , of 
an energy delivery device during a surgical procedure. The raw data, along with addftional data acqu*^ 
CPU 10? with information to generate at least one system output, as described m more detart abov* The raw date 
canbe intheform of any signal described herein with reference to the data acquisitionsystemo CPU 102.lt.s|mportarrt 
to note that the input instrument 108 can operate alone or in combination with other devces to prov.de CPU 102 wrth 
requisite information for generating system outputs. . „ 

Therefore, fluoroscopy system 118, one or more input devices 104, or a comb.nat.on of the two, can be considered^ 
input instrument 108 used in accordance wrth the present invention. By way ol example only, .npirt .nstrument 1 08 
includes but is not Hmrted to. a live fluoro video signal provided by a fluoroscope dep.ct.ng a surgical device having at 
least one sensor attached thereto, a live fluoro video signal as described immediately above m combmation wrth one 
or more input devices 104. a system utilizing magnetic fields generated by one or more magnetic sensors located on 
a surgical device, any other system which can provide position and orientation information of a surg.cal device, or any 

combination of the examples above. . _ . , ri . 

rOOSSl CPU 102 can be any programmable computing device having a m.croprocessor of sufficient efficiency such 
that the processes described herein are able to be performed within predetermined time limits, a memory module of 
sufficient size for the temporary storage of program and acquisition data, and storage devices for temporary and non- 
volatile storage of program and acquisition data (not shown). CPU 102 can be. for example a personal computer 
sySem or computer workstation, able to provide functionality as described herein. A storage dev.ee for ncrwolat.le 
so storage may include one or more hard disk drives or a more portable storage media. 

r00691 CPU 102 further includes a data acquisition system (not shown) capable of receiving vanous mput signals 
and converting such signals intoalorm more compatible for analysis by CPU 1 02. Such received signals include analog 
signals such as certain video signals or other varying voltage signals, digital signals such as swrtches handled as 
binary inputs, or any other signal capable of being described in terms of current or voltage. For examp e. whi> the 
source of a signal may be a transducer measuring a certain phenomena, the condrtioned signal provided to the acqui- 
sition system may be a voltage which is proportional to the unit-phenomena measured. The waveform of an electro- 
cardiogram (ECG) or an oscilbting signal representative of a patients respiratory cycle are two examples of such 

Sen' CPU 102 indudes, as part of rte data acquisition system, at least one. preferably two, video frame grabbers 
The frame grabber continuously receives a video signal in a known format, such as a standard NTSC or PALsignal, 
and. upon command, digitizes the current video frame being received. Addrtionally. the v.deo signal provided to the 
CPU 1 02 could be a digital signal provided by the fluoroscopy system 118. 

100711 It is important to note that the CPU 102 could have several frame grabbers, each frame grabber having a 
Corresponding video signal as an input, thus enabling the CPU 102 to receive and digitize several video signals . si- 
multaneously The digitized videof rame orf rames can then be stored for analysis and/or .mmediately displayed. There- 
fore since the frame grabber has the ability to freeze or otherwise grab and digitize a frame of video upon command, 
the digitized frame can be correlated with time, and each digitized frame from a plurality of frame grabbers will represent 

a specific view at one instant in time. .... . . .„ 

r00721 In a preferred embodiment and as discussed more fully below, the frame grabber includes additional inputs 
so from which to correlate with the video data Thus, for example, as a video frame is digitized, other Imown parameters 
regarding the patient such as current cardiac cycle data and current respiratory cycle data can be acqu.red and stored 
with the frame for later analysis. . „, 

f 00731 CPU 102 also includes a video combiner and at least one video output port which interfaces to the video 
display system 106 such that video signals generated in response to data acquired during a surgical procedure can 
ss be combined with other video signals such as the live fluoro views. The video combiner can be performed by hardware 
or software if requisite processor bandwidth is available. Display system 106 includes at least one video display to 
display the output video signal from the video output port of CPU 1 02 

[0074] The data acquisition system of the CPU 1 02 also receives an input signal from at least one input device 104. 
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The input device 104, as is described in more detail below, provides CPU 102 with data and/or other event-markers 
f rom which a correlation can be made with additional acquired data, such as video signals or discrete signals such as 
. the activation ot an energy source to be transmitted to a target tissue site by an energy delivery device. Therefore, 
input device 104 may be any suitable event marking device such as a switch, or may provide analog or digital data 

5 regarding the surgical procedure being performed such as signals received from a pointing device, or a combination 
of the two. Pointing devices contemplated herein include, but are not limited to, a computer mouse, trackball, light pen, 
keyboard, or any other device which can define a point in at least two-dimensional space, working alone or in combi- 
nation with another structure such as a video display. Alternatively, input device 104 could be a switch whose signal 
is acquired by CPU 102 and defining an event which then provides a basis for further data analysis, as described in 

io more detail below. 

[0075] Based on input data provided by at least one input instrument 108 and at least one input device 104 during 
a surgical procedure, each of which may also define surgical procedural events, CPU 102 can process the data with 
reference to the events acquired and display desirable information in response to the events in real-time or near real- 
time during the procedure. The displayed inf ormatbn can be displayed on one or more video displays as part of video 

is display system 106 and/or on one or more live fluoro video displays, as discussed below. 

[0076] The surgeon performing the surgical procedure can then use this displayed information to track progress or 
more accurately position surgical instruments utilized during the surgical procedure. For example, during a PMR pro- 
cedure, as is fully discussed below, revascularization channels created by a surgeon can be tracked and mapped in 
an efficient manner providing the surgeon with a level of certainty that the channels are being created at a desired 

20 location and a predetermined distance from each other within the left ventricle. Further, the displayed information can 
be used in real-time to assist a surgeon in placing the distal tip of an energy delivery device at the desired target tissue 
site. 

[0077] Prior to performing a PMR procedure, the CPU 1 02 acquires two virtual two-dimensional depictions of the left 
ventricle, sometimes referred to as ventriculograms or V-grams. While the two-dimensional depictions or V-grams can 

25 be created from any two non-parallel planar perspectives, the two-dimensional depictions are preferably created from 
the RAO and LAO views. The angle sensor 1 1 2 of the fluoroscope 1 1 0 provides the CPU 1 02 with an angle relationship 
between the two planar perspectives. It should be clear, therefore, given the angle relationship, a point object in each 
perspective can be defined as the intersection point of two lines, a first line normal to the first planar perspective, and 
a second line normal to the second planar perspective. 

30 [0076] A radio opaque dye is injected into the left ventricle. Since the radio opaque dye absorbs X-ray radiation, the 
dye will create a contrast between the surrounding tissue of the left ventricle and the left ventricle chamber itself. The 
resulting fluoroscope image is provided to CPU 1 02 for acquisition. In a preferred embodiment of the present invention, 
the major features of the acquired heart image, such as walls and coronary vasculature, are also outlined using input 
device 1 04, such as a computer mouse or light pen. The ventricle outline acquired, and coronary vasculature if desired, 

35 is then overlaid onto a corresponding live fluoro display providing the cardiologist information regarding the ventricle 
structure after the dye has dissipated. 

[0079] More specifically, with an RAO view being displayed and using the input device 1 04, the cardiologist outlines 
the left ventricle wall structure as defined by the contrast developed by the dye, defining the RAO view of the left 
ventricle chamber. The cardiologist outlines the left ventricle wall by identifying several points along the dye-defined 

40 chamber wall. The points are identified by manipulating the input device 1 04 to the edge defined by the dye and heart 
tissue and sending a command to CPU 1 02 to acquire and define that point Once an adequate number of points have 
been defined, typically 16-20, the CPU 102 is commanded to connect the individual points with a smooth line, using 
interpolation techniques, resulting in a well defined left ventricle chamber with respect to the RAO view. In a similar 
fashion, with an LAO view being displayed, the above procedures are performed again to define the left ventricle 

45 chamber with respect to the LAO view. 

[0080] Outline views RAO-O and LAO-O as shown in Figs 2B and 2C, respectively, are exemplary resultant views 
as processed by CPU 102 based on inputs provided by the cardiologist Once acquired, the outline views are then 
stored in CPU 1 02 for later use during the surgical procedure. As is discussed in more detail below, the outlines obtained 
of the left ventricle above can be provided as an overlay to a live fluoro video signal by the combiner of CPU 102. The 

50 combined image is then provided to video display 116 such that, after the radio opaque dye dissipates, the overlay 
provides structural definition which would otherwise not be visible. If a second video display 11 6a is utilized, a combined 
image corresponding to the RAO view could be displayed on video display 1 1 6 while a combined image corresponding 
to the LAO view could be displayed on video display 116a 

[0081] Alternatively, with a video display 116 of sufficient size, both, RAO and LAO, combined images could be 
55 displayed on a single video display 116. Furthermore, if it is desirable to display live fluoro separate from combined 
images then live fluoro could be displayed on video display 116, 116a and the combined images could be displayed 
on one or more video displays as part of video display system 106. Each monitor 116, 116a and video monitors of the 
video display system 106 have a "last image hold" function, if applicable, to allow the user to simultaneously compare 



8 



2/14/2007, EAST Version: 2.1.0.14 



EP 1 057 455 A2 



one or more video images. The last image hold function can also be performed by the CPU 102. In this 

ment. the CPU 102 can. hold or freeze one image with respect to another image when both images are part of a single 

video siqnal provided to a video monitor for viewing. 

r00821 In addition to the V-gram. an angiogram can be performed by injecting radio opaque dye into the heart vas- 
culature. Using outline imaging techniques described above, the angiogram could be used to estirmte the ouler surface 
of the ventricle while the V-gram acquired above provides an estimation of the mner surface .and. thereto re ar . esh- 
mation of the heart wall thickness can be made. If only single plane data is collected, then the myocwW \^m» 
in that plane can be estimated. Alternatively, if data is collected from multiple v.ews (using ertherab^neora single 
plane fluoroscopy system), then the myocardial thickness with respect to the two views, such as RAO and LAO Vl ews. 

moan 6 Asfe^'fully discussed below, in a more preferred embodiment, the V-gram and angiogram outlined images 
^in^ thTghl use ot video signa. digitization and acquisition of the digitized signal by the CPU l<& CPU 
102 acquires the outline image definitions using edge-detection algorithms such that when the radio opaque dye is 
injected into the left ventricle the contrast between the dye within the ventricle and the ventncle wa I is percerved. As 
discussed above relative to the manuaHy obtained outline images, the outline images acquired by the fluoro video is 
stored for later use during the surgical procedure. 

ro084] With reference now to. Fig. 10, output depictions generated by the present invention can be more readily 
understood Fig 10 is a representative view of several outputs generated by the tracking system as displayed on a 
single monitor As stated above, while the output depiction is shown on one display, several displays 116a could be 
IS ItodSS^e output information. With specific reference to Figs. 10Aand 10B. RAO and LAO combined .mages 
are shown During a surgical procedure, as discussed above, the CPU 102 digitizes live fluoro .mages resurt.ng in 
working images A working image is defined or created for each video input corresponding to a partcularvew. an RAO 
or LAO So; example During methods in accordance with the present inventton certain algorrthms are executed 
by CPU 102 resutting in the depiction of position and orientation information of a portion of the energy delivery device 
(not shown) being merged with other information, such as the stored outline images RAOO and LAOO and target 
£e sTs show!, as 1 and 2 in Fig. 10. defining the location of an application of a desired therapy. .nto the corre- 
sponding working image. This is generally referred to as therapy mapping and . more specfically. channel mapp.ng. 
ThTwoLg image B *en overiaW ontothe live fluotovideoof the responding view by the comb.ner and d B p^ 
The outline views. RAOO and LAOO. are representative RAO-30 and LAO-60 v.ews obta.ned as d"***™* - 
T00851 The symbols V. 'X\ and 'O' are used by CPU 1 02 to align the current working .mage wrth the live fluoro 
video, as is described in more detail below. This helps to compensate for any rotational movement of the patient wrth 

ST T:^ZTZ^U the LAO view is generated in its entirety by CPU 102 aLowing for a more 

expeditious procedure when only a single-plane fluoroscope 110 is available ... h Cin 

[0087] Nowwith reference to Fig. 10C and Fig. 2A. another output generated by the present .nventon is shown^Fig^ 
10C depicts an unfolded two-dimensional view of the left ventricle of the heart having the centerlne of the lateral surface 
alonq the longitude! axis ot the left ventricle of the heart defining the center Tine or central axis d fre view, starting 
She baSi surface, labeled B. on the left and leading to the apical surface, labeled A. on the nght This particular 
output provides a more simplistic view of the heart reducing the time which a surgeon uses in interpreting live fluoro 

or other more complex images of the target tissue site. 

Tn impanson with the depiction of target tissue sites 1 and 2 of Figs. 10A and 10B. Fig. 10C shows srte 1 
more apical and more inferior than site 2. Under certain circumstances, target tissue sites may seemingly overlap each 
other in a specific view. The surgeon must then continuously scan the views, in this case the RAO and LAO views, to 
JetoJine £e spacing between target tissue sites. In contrast, only the view of fig. 10C is needed to ensure proper 

EuST *£ IXZSL in more detail be.ow. with an input device 104. the surgeon can define a site wrthin the 
Lodimenstonal view of Fig. 10C and the CPU 102 will provide approximations of the target tissue site as part of 
wo^rJnagesto be combined with live fluoro. The surgeon can then guide the distal tip of the energy delrvery dev»e 
to the desired site and apply the desired therapy, ensuring that the site is at a predetermined location wrth respect to 

Soso^oSS generated output in accordance with the present invention is shown in Fig. 10D. Fig. 10C .provides 
a wire frame depiction of the left ventricle created by the CPU 102 from the outline images RAOO and LAOO and 
defined target tissue sites. The outline views are referenced tothe interventricular and atricwentncular planes as shown 
in Fiqs. 3A and 3B and discussed above. . 
roooil The three-dimensional depiction of Fig. 10D can be manipulated by the surgeon or an assistant durmg a 
surqical procedure by providing commands to CPU 102 via the input device 104. such as a keyboard or computer 
mouse Tnus, the surgeon can rotate the depiction about any axis and view the orientation of the target tissue srtes. 
In a more preferred embodiment, the depiction would include an image representative of a distal port.on of an energy 
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deliveiy device within the left ventricle (not shown for clarity) allowing the surgeon to more accurately advance towards 
and place the distai tip of the energy deliveiy device at a desired target tissue site. 

[0092] With reference to Figs. 4C and 4D another generated output in accordance with the present invention is 
shown As is discussed in more detail below, one embodiment of the present invention utilizes a single view, an RAO 

s view for example, and derives either a generated LAO view or a clock face image representative of the orientation of 
the distal tip of a specific energy delivery device. Using the crock face analogy, the LAO depicted view would show the 
anterior region of the heart from about 11:00 to 2:00, the lateral region from 2:00 to 5:00, the inferior region from 5:00 
to 8 00 and the septal region from 8:00 to 11:00. As is shown in Fig. 4C. the energy delivery device is the catheter 
500 oriented such that the aligning catheter 502, the laser catheter 504. the fiber optic or fiber bundle 508 are all parallel 

io to the RAO plane of view. Therefore, in the LAO view, the depiction of the catheter 500 could be made with a single 

[00931 The clock face 1 depicts the orientation of the distal portion of the energy delivery device, and in this case, 
tine laser catheter 504. the fiber optic or fiber bundle 508, and the distal tip 510. where the center of the clock face 
depicts the mam axis of the laser catheter 504. Therefore, as shown, clock face 1 comprises a circle havmg a vertical 
is arrow extending from the center of the circle to the outer surface, the vertical arrow depicting the orientation of the 
catheter 500 in the LAO view being parallel to the RAO plane of view. 

[0094] In contrast, with reference to Fig. 4D showing the catheter 500 distal tip rotated towards the lateral surface 
of the left ventricle the clock face 2 depicts the LAO view of the distal tip of catheter 500 pointing into the RAO plane 
view. Thus, a surgeon or other person present during the surgical procedure has a depiction of the distal tip onentation 
so while looking at the single RAO view. . .. . . 

[0095] Additionally, a clock face depiction can be provided for each treatment location using methods described in 
detail below. Each clock face depiction representative of a treatment location can be viewed continuously or at the 
command of a user, such as the surgeon, during a procedure, by selecting the channel site or location wrth an input 
device for example. 

25 [0096] Also in accordance with the present invention, CPU 1 02 can provide a plurality of system signals related to 
the surgical procedure and displayed via indicators such as light emitting diodes devices on a display as part of video 
display system 106 or video dispiay 116 or as graphical images merged into the working rmage and combined with a 
video signal and displayed on video displays, as described herein. 

[0097] These system signals may be discrete or binary signals representative of patient or surgical procedure status. 

30 such as alarms preventing the application of a desire therapy more than once at a given target tissue site. Additionally, 
these system signals may also be related to the tracking system itself providing an indication that the system is not 
ready to acquire data, for example, or displaying system errors. Also, these system signals may involve the interaction 
between the tracking system and the surgical procedure. For example, if the energy delivery device is a laser fiber 
used to transmit laser energy to a target tissue site, it may be desirable to have the tracking system control the energy 

ss source such that the energy source is activated and energy is transmitted through the laser fiber only under certain 
conditions relative to cardiac or respiratory system cycles. The tracking system could provide an indication that the 
energy source is under its control. 

[0098] It should be clear, while outputs are described separately above, the actual output from CPU 1 02 can compnse 
one or more of the outputs described above, in combination. As also staled above, it is important to note while these 
40 examples pertain to a PMR procedure specifically, it is apparent that such a system can be used m the placement ol 
other surgical instruments and/or the application of materials such as various drugs or therapeutic agents, salme or 
other fluids, or other substances as described in U.S. Patent No. 5.B40.059, entitled Therapeutic and Diagnostic Agent 
Delivery", incorporated by reference in its entirety. 

[0099] With reference to Fig. 1 , a first embodiment of an enhanced tracking system in accordance with the present 
4S invention incorporating features described above pertaining to the general embodiment, can be more readily under- 
stood As stated above, the tracking system 100 includes the input instrument 108, the CPU 1 02, and the video display 
system 106 To assist a surgeon during a PMR procedure the fluoroscopy system 188, incorporating a fluoroscope 
11 0 and one or more video displays 1 1 6. is typically utilized. Also, fluoroscopy system 11 8 provides gu idance in placing 
the distal tip of an energy delivery device, which incorporates at least one sensor, at a target tissue site. In this first 
so embodiment, fluoroscopy system 118 also acts as part of input instrument 108, providing, in part, position and orien- 
tation information regarding the energy delivery device. 

[0100] With reference also to Fig. 9A. a PMR procedure in accordance with tracking system 100 will be discussed. 
Fig 9A is a representative flowchart of a preferred method performed m accordance with the first embodiment of the 
present invention During the performance of the preferred method one or more fluoro images are digitized into working 
ss . images Other data are then acquired and analyzed by CPU 102. the result then being combined with the working 
images and provided as one or more output. Based on data analysis techniques other outputs, as descnbed in more 
detail above are also provided by CPU 1 02 assisting the User in performing the surgical procedure. The fluoro images 
are provided by the fluoroscopy system 118 and preferably comprise RAO and LAO views obtained from a b.-plane 
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foTmi^e preferred method of F.g.9A is accomplished by a User, such as a cardblogist, or other surgeon performBig 
IwJ^Se o?an assistant present during the surgical procedure aiding the cardtologist or surgeon m cc^ 
binaltofwr^PU To 2 hardware under software or firmware control in combination with the fluoroscopy system 118 

^tSKSa videoframe as part of the video signal 120 receivedfrom video source ,114 by CPU 
102^ digged by the frame grabber. In a preferred embodiment. CPU 102 composes two frame grabbers each frame 
orabber diattizing a separate video frame from a separate fluoro video signal as part of video s.gnal 120. the two 
s^lXo frames being digiflzed simultaneously, and each frame representing a different perspecuve or view, 
suS as F^S TJSZ viewl respectively. The two digitized frames, since they are digitized simultaneously, are ref- 
arartced to and thus, represent the respective views at the same instance in time. 

other data, as is described in more detail below. After the working images are defined, the wortong rnages are then 
reatetered with or otherwise correlated with, various bodily signals produced by body systems of the parent, ,n a step 
52 Fore^mp^ ECG and respiratory cycle signals acquired by CPU 102. as described above, could be obtained 
• i^e daS sit^ system wEen the frames are digitized in step 1 50. allowing the correlate between flu , cuirerrf 
f rame views and the acquired ECQ and respiratory signals. In this regard. ECG and respiratory s.gnals. along wrth 
S STsy^em signals, are considered part of input instrument 108. AJso contemplated as part o^ step 152 «£d 
be any required signal conditioning of the acquired bodily signals. Such condrt.on.ng may .nclude filtenng of electrc- 
maonetic or electrical noise as part of the signal acquired. . .. ... u jk. 

X] 1 I should be apparent mat the digrtization of frames in step 150. rather than compared wrth ex«tmg bodrty 
could be perfo^ed in response to one or more bodily signals, such as an ECG signal ^ch fl^at a djgrtjzed 
K of substantially similar orientation is continuously acquired in step 150. For example, the RAO and LAOd.grt.zed 
ran^ cou^Sired with respect to the end-diastole phase of the cardiac cycle rasulfing .n substantia* ■ similar 
Smes over a period of time. The frames could also be further correlated with a point wrthm the resp.ratory cycle, such 
asTe Z m£ .point. As will later become more apparent, these ^^^^^ ^ 
virtual depiction of the large! tissue area of a heart generated as part of one or more CPU 102 outputs^ 
SSSl DuS Se step 1 52. the digitized frames themselves may also be subjected to the same or drtferent s.gnal 
KoJng ^^esses described a£ve to eliminate undesirable noise or put the frame in a format more suitor 
Ser anaLis by CPU 1 02. Undesirable noise is meant to be defined broadly, when d.scussed .n relat.cn to d grUzed 
resTr o^er signals acquired, as the removal of any part of the digrtfced frame or acquired sign* I resufling r , . 
SerunderstanJ^^ 

SSS At the end of step i£yhe CPU has acquired two fluo^vid^rames defining two wortcng "^and has 
Sed or registered these wking images with vartous-o^g^ 

SuSd data, while stored in random access memory of CPU 102. can alsobe stored on * « » nonfat le storage 
Svice^f CPU 102 for laterviewing or analysis. For example, after the procedure is performed, these woriang .mages 

and others stored could be reassembled into a histology of the procedure for review. q 

m-To^ I Onc^the digitized frames are registered in the step 152. CPU 1 02 enters a reactionary mode, reacting to one 
or more Tevents occurring during the procedure. These events include, but are not limited to. a ^marker 
detection event, a V-gram detection event, an energy delivery device detection event, and atreatment event Each of 
STesfe^rare provided toCPU 102 by the User's manipulationof one or n^ehput devices 104. For example, wrt^^ 
Teference to Rg 10E. the User may inrtLe an event by selecting a button B1 which may be labeled wrth the event, 
^ri b^MOTION MARKER DETECTION" (specific labeling not shown). CPU 102 detects and mterprets this 
inDut in this case, as the motion marker detection event, in a step 1 50. ^- .• „„ „,,« 

Si Memafively, this or other events could be defined by the closure of a switch or switch combination, as part 
of input dei^e M elated to the specific event Thus, the User can use the fcput devce 104 to align a cursor or 
^haiSamotionm^ 

event and commanding the CPU 102 to interpret the cunent location of the crosshair as the tocaflon of the motion 
marker, as described in more detail below. 

f m o?] |norderfortheCPU102tocorrelatecurrent^^ 

Z patient's body with respect to fluoroscope 110 must be defined. Motion markers are utilized by the combmer of fte 
CPU ^ Sitf^ generated working frames with l*e fluoro views. Thus, when a patienfs body rotates or otherwise 

.^^respJ. to a particular vL. the working image can be rotated or otherwise oriented such *atthe wortong 
insane is aligned wrth the respective live fluoro view. As described above, the moflon markers can be rado opaque 
markers of various shapes and sizes strategically placed at known locations on or within the patienfs body, remammg 
TpS andSn atleast one perspective view, the RAO view for example, during the duration of the surgical pro- 

SmJ" By^olexampleonly.radteopaque 



11 



2/14/2007, EAST Version: 2.1.0.14 



EP 1 057 455 A2 



of such markers, the markers of Fig. 10A being placed on the chest region of the patient's body and the markers of 
Fig 10B being placed on the left side of the patient's body. 

[01111 Once the CPU 102 enters the motion marker detection mode it acquires the present location described by 
input device 104 in a step 162. Next, in a step 164. the orientation of the working image within the CPU 102 is manip- 

s ulated such that the working image orientation is essentially similar to the orientation as observed in the live fluoro 
image Therefore, if, for example, the patient's body rotates X" with respect to the center of the live fluoro image 
provided by fluoroscopy system 1 1 8 such that the location of motion marker -X" of Fig. 1 0A is shifted X" when compared 
to a working image overlaid onto the live fluoro as discussed below, the User could redefine a new motion marker 
location In response to the new motion marker location. CPU 102 would rotate the working image X» in its memory 

io prior to combining the working image with the live fluoro such that onty one set of corresponding motion markers are 
visible in the output. . 

[0112] Once the motion registration markers have been obtained from the digitized frames, representative of the 
RAO and LAO views, the frames can then be correlated to previously obtained frames of the RAO and LAO views, 
respectively, by CPU 1 02. The placement of the motion registration markers may be made to allow the markers them- 
75 selves to be fluoroscopically viewed in other planar views. Thus, for example, the side views of motion markers of the 
RAO view of Fig 1 0A could be viewed in the LAO view as indicated by markers V and '-' of Fig. 1 0B. The additional 
views of these markers allows CPU 102 to more accurately correlate past working images with currently acquired 
frames or working images. 

[0113] In a similar fashion to the motion marker detection event, CPU 102 checks for a V-gram detection event 
20 provided by the User in a step 170. In step 1 70 the CPU 1 02 looks for or otherwise detects whether a V-gram is presently 
being performed, i.e.. a V-gram event has been provided by the User, as a prelude to obtaining outlined structural 
views such as RAO and LAO views, of the left ventricle. If a V-gram is being performed, radio opaque dye is injected 
by the User into the left ventricle concurrently or immediately after the V-gram event With the dye providing a contrast 
between the left ventricle chamber and the surrounding tissue, an outline of the left ventricle is performed in a step 
ss 172 as described in greater detail above. The outline images of the left ventricle obtained in step 172 are stored in 
either volatile or non-volatile storage devices in a step 174. Typically, the outline images are obtained once, at the 
beginning of the surgical procedure, and then are continually combined into the current working image in a latter step, 
discussed below. However, if required during the procedure, the User can obtain new outline images of the left ventncle 
per steps 170-174 as discussed above, the new images being stored or otherwise replacing the previously obtained 
30 outline images. 

[0114] Additionally, the chamber of the left ventricle can be further defined by placing the distal tip of the energy 
delivery device against the wall of the heart and commanding the CPU 102 to acquire the location of the distal tip of 
energy delivery device, as is discussed in more detail below. The acquired points could then be stored and later utilized 
providing that location to the CPU 102 

ss [0115] As with other events discussed above. CPU 102 checks for an energy delivery device detection event in a 
step 180. During a PMR procedure in accordance with the first embodiment of the present invention, the distal tip of 
the energy delivery device 300 is viewable on the live fluoro mages by the User. As stated above, the device 300 may 
comprise sensors including radio opaque markers. The energy delivery device 300 of the first embodiment of the 
present invention comprises at least one radio opaque marker 31 2. the marker being placed at the distal tip 310 of the 

40 device 300 such that the distal tip is readily recognizable in the live fluoro. If, during the procedure, it is desirable to 
record or store the current position of the distal tip 310 of device 300. the User, using the input device 104, provides 
the position by placing the crosshair over the live fluoro image and commanding the CPU 102 to acquire the point 
defining the current distal tip 31 0 position in a first view, the RAO view for example, in a step 1 82. 
[0116] Using a live fluoro freeze capability as part of Ihe frame grabbers of the CPU 102. the User can acquire distal 

4S tip 31 0 distal tip position information in a second view, the LAO view for example, as part of step 1 82. The second view 
when combined with the first view provide information for the CPU 1 02 to generate a virtual two or three-dimensional 
view, or other desirable output described above. In a step 1 88, the position information obtained in step 1B2 is merged 
into the working image. _^ , , . . 

[0117] CPU 102 also checks for the occurrence of a treatment event in a step 200. The application of a desired 

so therapy at a target tissue defines the treatment event. For example, activation of an energy source by depressing a 
foot switch as an input device 104. could be used to define the treatment event As stated above, the desired therapies 
include application of drugs or angiogenesis agents, other fluids, or ablation energies designed to remove or otherwise 
cause an injury to tissue. Once it is determined by CPU 102 that a treatment is in progress, the position of the distal 
tip 310 of energy delivery device 300 is obtained in a step 202 and combined with the working images in a step 208 

ss in a similar fashion as in steps 1 82 and 1 88. respectively. More specifically, typically the treatment location is described 
in terms of the distal tip 31 0 of energy delivery device 300. Thus, the treatment location is the dislal tip location obtained 

1 82 * 
[Oriel] Prior to application of a desired therapy or treatment, sometimes it is desirable for the User to determine 
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whether contact between the distal tip 31 0 of the energy delivery device 300 and the target tissue site tes ted. 
Fto ^ampte this is desirable prior to activation of a laser energy source which results .n the creation of a ™****»' 
Si^neL^tionoimebser energy source while fte dista. tip is in contact with a wall o. the. eft venule 
fundesS siKce energy is applied directly to blood cells flowing through the ventricle rather than wall t,ssue rtself . 
MM P enminary^tepToOA of step 200. therefore, the User would not enable an anergy source, proving 
CM M02wfth a treatment even,, until the distal tip 31 0 of the devtee 300 is in contact wrth a wall surface , * th .left 
ventrfcte Contact between the distal tip 31 0 and the wall surface can be estimated from a companson of ttte , dkM tip 
310 as viewed in the live fluoro image, with the outlines of the left ventricle made part of an output of CPU 102 as 

Asynchronously with the beating of the heart and. more specifically, the contraction and relaxation erf the left 
3 Keif At this point the User can pass the treatment event to CPU 1 02 resulting in the acqu.srt.on and manp- 
Son o/Sta as dfecussed above with regam to steps 202 and 208. Vfcll contact may or may not be a prerequ.s.le 

to ihe application of the desired therapy. J ^„j rf .- < «,i M rfhi,rpiji09 
[0120] Tin a step 210 the working images, including the V-gram outline .mages and other data acquired by CPU 02 
Ls described herein, are combined with respective live fluoro views, the combined output being provded by CPU 1 02 
to S dfpbys 116. and video dispfey system 10B as an output video signal 122 for viewing by operat.ng room 
rson^el. before the fluoro video 120, comprising video signate representing RAO and LAO v.ews recede «^ 
CPU^02 is combined with the saved outline images of the corresponding perspective v,ew by the combiner art pro- 
vided as the video signal 122 at the video output port Therefore, the video display 11 6 could contain, for example, the 
£fl£c TvteT £X RAO perspective with the RAOO outlined image as shown in Fig. 2B supenmposed thereon 
Sng^SSJ I an estimationof the leftventrb.e shape along rts longitudinal axis^ SWar^ a viewcorre^ng 
totoe LAO perspective with the LAO-O outlined image as shown in Fig. 2C is proy dec by CPU 1 02 W»^a 
M21] Addrtionally.asdescribed above, otheroutputs can be generated by CPU102.nafir^ step 220tobed B played 
on one or more video delays 116. 116a and/or an additional display as part of the video display system JOG m 
^ponsetoframe data and otherdata acquired in accordance with the present invention and at the request of the User 
Steps 150 through 220 define a main loop which is to be performed frequently enough to tfta r tor useful 
visuS response typically between 3 and 10 Hz. Also, the User inputs resulting .n vanous events bemg provded to 
CPU Srame than beTng performed sequentially as part of the method of Fig. 9A. could be interrupt-based events. 
tS is Tn2n toop coud be shtoly defined as steps 150. 152. 210. and 220. and User inputs defining the events 
IsSiied abSe would interrupt the processing of main loop steps and force CPU 102 to momentanly address and 

JST tip 310 against a target tissue srte. the Use, using the input device 104. woud 

proSe to CPU 1 02 an input defining a treatment event. The CPU 102 would stop runmng one of the main loop steps 
?50 1 52 210. or 220. and execute steps 202 and 208. The CPU 102 would then return to anc I continue executing 
35 Sn loop steps after execution of step 208. Such a system is more efficient since it forces^ CPU to focus on tasks 
desiredby the User. The gains of such a system are more realized bebw in discussmg further embedments. 
SSf Wrth ref erence ateo to Fig. 10. the combination of software executed by CPU 102. manual input provided by 
Seuir^d^ 

2n be keener understood. The Use, through a software interface of CPU 102. such as a button B2. as shown .n Fig. 
40 10E which may be labeled "DEFINE TREATMENT LOCATION" (specific labeling not shown), notrfles and commands 
ie cSSacquire a data point (XI MCh VW corresponding to the distaJtp 310 of an energy del,verydev K e 300 
Jot shoJn) i Ta S view, the RAO iewfor A The pomt is defined, as described above, by movmg , a cr^sha r 
over ttie distal tip 310 and then signaling the CPU 1 02, by clicking the mouse for example, to acquire ® ^|^?^J" 
the^RAO view. In a similar fashion, a data point (Xlm& ^laoI ' s acquired with respect to a second view, the LAO view 

45 t^^o^^e* or otherwise provided to CPU 102 by the User, a two or three^imensiona. 
Sbn^dSpohtwrthrespecttoc4her 
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K f^eTtwo, two-dimenstonal data points obtained with respect to two dfflerent vbws. ™ «^£>™ 
so L example, along with the angular relationship between the two views can be oomb.ned to generate a Jree^en- 
stonaS point The generated three-dimensional data point is defined by two lines, a first line P^nd.cuter to *» 
first view and a second line perpendicular to the second view, each line passing through or intersecting a twMtomn. 

I then calculated to be the midpoint of the shortest line segment between these two Imes, rf any. Note that these 
55 calculations do not require the two views to be orthogonal, but rather that they not be coincdent 

roi 271 For example, the outlined images of the left ventricle, since the onentation planes are known, can be repre- 
sented in a twc-dimensional depiction as shown in Fig. 10C or a three<iimensional depiction as shown m FigJOD. 
F JJhlr, a firstgVnerated data point (XI Yl .2/), since its orientation with respect to the RAO and LAO outlines ,s known. 
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can be merged into the same three-dimensional depiction, as shown in Fig. 10E and described in more detail above. 
During the surgical procedure, a number of additional treatment location points n, (X2.V2^2) :.. (Xn.Yn,Zn), are later 
obtained and merged with the RAO and LAO outline views and other data as part of current working images, and later 
combined with the live fluoro by CPU 102 for display on video screens 116, 116a, and/or a video display as part of 

5 video display system 1 06. 

[01281 In a more preferred embodiment, the catheter location data points obtained in step 182 are stored in non- 
volatile memory such that each data point or a defined group can be recalled and merged into the current working 
image in step 188, at the request of the User. For example, the User can define a series of data points as a first row 
of treatment locations. The row can then be merged, at the request of the User, into any given working image and 

10 combined with the live fluoro image for viewing in one or more outputs of CPU 102 as defined above. This allows tte 
User to better interpret and differentiate one set of channels, for example, on one interior chamber wall of the left 
ventricle from another set. This also allows the User to systematically display various groups of channels to better 
understand the position and orientation of such channels with respect to other sets or groups of channels. 
[01 29] As stated above, the steps of Fig. 9A define a program loop continuously executed within predetermined loop- 

is cycle time limits. In a more preferred first embodiment of the present invention, inputs other than V-gram, and treatment 
related events directly provided by the User, would not be required. Ralher. the CPU 102 would be incorporated with 
additional software comprising one or more algorithms directed to performing object detection, motion detection, edge- 
detection, or other image-analysis to, for example, automatically determine the location of various radio opaque mark- 
ers Thus in the step 160 of Fig. 9A, the CPU 102 would analyze the current digitized frames obtained in step 150 to 

20 determine the location of the motion registration markers. Characteristics specific to individual markers help to differ- 
entiate the markers during CPU 102 analysis. 

[0130] The CPU 102 would then analyze the frame and compare image portions in high contrast to surrounding 
portions with the known images of the motion registration markers utilized during the surgical procedure. Once the 
location of the registration markers is determined, the CPU 1 02 would combine this information into the working frames. 

25 as discussed above. . . . 

[01 31] Additionally, in step 1 70. the ventricular outline following a contrast injection in fluoroscopic acquisition of a 
left V-gram can be acquired using edge-detection algorithms. Thus, as part of the step 170. the CPU 1 02 would analyze 
a digitized frame after the radio opaque dye has been injected into the left ventricle of the heart, based on a V-gram 
event provided by the User. Applying edge-detection algorithms to the contrast produced by the dye in the acquired 

30 frame. CPU 102 will determine the left ventricle structure and produce the outlined RAO and LAO views as discussed 
abovs 

[0132] Using an edge-detection algorithm similar to the one used in step 170 immediately above, the distal tip 310 
of an energy delivery device 300 having a distal tip 31 0 radio opaque marker 31 2 attached thereto can be detected in 
the digitized frame in step 180. Furthermore, the obtained position of the detected distal tip 310, during anaiysis of 

as several consecutive frames, can be compared with an ECG signal supplied to CPU 1 02 to determine whether the d.stal 
tip 310 is in contact with the left ventricle wall, as part of the wall contact preliminary step 200a. 
[0133] In similar fashion, treatment areas acquired in the step 202 are detected and combined into the working 
images through the use of frame anatysis incorporating deteclbn algorithms by CPU 102, as discussed above regarding 
steps 200-208 Additionally, when the CPU 1 02 detects a Treatment event defined above, rather than acquiring a point 

40 defining the application of a desired therapy, the CPU 102 could acquire a treatment area defined by the specific 
acquisition of a number of points further defined by the movement of the distal tip of energy delivery device 300 during 
the treatment event The acquired treatment area would then be merged into the current working image m the step 208. 
[01 34] If wan contact is a prerequisite to application of a given therapy the energy delivery device 300 could comprise 
a functional device which would then detect wall contact and provide the information to the CPU 102 for interpretation 

<5 and control purposes. For example, the functional device could comprise a pressure transducer which is then used to 
detect waff contact as described in EPO Publication No. EP 0 868 923 A2. entitled 'Steerable Catheter with Tip Align- 
ment and Surface Contact Detector', published on March 31 . 1 999. 

[0135] Now with reference to Figs. 9C and 9D. a preferred object, motion, and edge^etection algorithm for the 
detection of radiopaque markers on an energy delivery device 300 as part of step 182 used during a surgical procedure 

so in accordance with the first embodiment of the present invention can be more readily understood. The algorithms 
defined below don't detect the distal tip 310 itself. Rather, the algorithms detect the radio opaque marker 312 as part 
of the distal tip 310. providing a relative location of the distal tip 31 0. Additionally, as the algorithms defined below can 
detect the marker 312 on the distal tip 310, the algorithms can also detect other markers placed along the energy 
delivery device, as discussed in more detail below. 

55 [0136] Figs 9C and 9D define a main algorithm and a sub algorithm, respectively, which provide CPU 102 catheter 
tip location and orientation information. The algorithms are based on User supplied parameters which can be provided 
to the CPU 102 in any suitable matter, such as with a keyboard or other alphanumeric data entry device. Algonthm 
parameters include the size of an extracted sub-image as part of the working image to analyze; the extent to which 
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the sub-image data is filtered; the number of representative images to match with the sub-image; and the variance 
parameter for a Gaussian function. • 
[0137] With particular reference to Fig. 9C, an initial estimate is obtained by CPU 102 of the distal tip 312 position 
in an initial step 10. The estimation provides a starting point for the CPU 102 algorithms defined by Figs. ?C and 9D 
5 to initiate detection of the marker 312 on distal tip 310. It also allows for faster tip 312 recognition, reducing the area 
CPU 102 must investigate in its search for the exact location of tip 312, as will become more apparent below. 
[0138] Theestimationoftip310positionisprovidedtoCPU102bytheUseru 

discussed above with regard to marking data points. Alternatively, the CPU 102, during step 10, could initiate a sys- 
tematic search for the tip 312, as part of a step 10A (not shown), by analysis of the working images obtained from the 

70 digitized frames as described above. As is described in greater detail below, the algorithm of Fig. 9C can be used to 
search the entire area of a given working image. The CPU 102, in examining the entire image, may find several pro- 
. spective tip candidate points, one true tip and other erroneous tips. The CPU 1 02 would then analyze each candidate 
using algorithms described herein and related to Figs. 9C and 9D to find the one true distal tip marker 31 2. 
[01 39] Afterthe initial estimate of tip 31 2 position is 'obtained by CPU 1 02, a variable initialization step 1 2 is performed. 

is During step 12, variable i, representing the number of working images considered during the current sequence, is 
initialized to equal zero and tip 31 2 velocities in the xand ydirection of the working image, i.e., V x and V r are initialized 
to zero. Here, the variables xand y are variables representing any two-dimensional space. Thus, if the working image 
is the RAO view the dimension variables would be x and z, rather than x and y. 

[0140] As shown, a step 14 defines the start of a main loop of the algorithm of Fig. 9C. During step 1 4 a small sub- 
20 image / surrounding the current location of distal tip 31 2 is extracted from the current working image. The sub-image 
of a predetermined size defined by the User is selected and obtained from the working image to reduce the possibility 
of erroneous detection of tip 312 and speeds the processing of the algorithm of Fig. 9C since it dramatically reduces 
the area which CPU 102 must analyze. The selected size can be in any suitable form including video elements, such 
as pixels or memory characteristics, such as bits, bytes, words, etc. Since this is the first time step 14 is executed 
25 during the current sequence the current location used would be the estimation obtained in step 10. However, during 
analysis of consecutive working images as part of the current sequence, the current location would be the actual 
location calculated in a previous iteration of the main loop. 

[0141] The sub-image f is then filtered in a step 16 by subtracting a median-filtered version of the sub-image f from 
itself the step being represented by the mathematical expression f m = /- median-filtered(/), as shown. The filtering of 
so step 1 6 removes slowly varying brightness changes from the sub-image f m and thus causes the background detail of 
the working image, as part of a digitized fluoro image, to contrast against the moving radio opaque tip marker 312 of 
energy delivery device 300. The distal tip marker 31 2 of the energy delivery device 300 is then located, due to analysis 
of contrasting elements within the filtered image i m in a step 18. 

[0142] The newly acquired catheter tip marker 31 2 location is then stored by CPU 1 02 in memory as x and y coor- 
35 dinates with respect to the current working image /. Therefore, for working image 0 (/= 0), the point (x(0),y(0JI would 
represent the currently acquired coordinate for the distal tip marker 312. 

[0143] In a step 22, velocity vectors V x and V y are calculated by subtracting the last marker 312 coordinate position 
from the currently obtained position for a working frame > 0 (/> 0) as part of the current sequence, A distal tip 312 
location estimation is then calculated in a step 24 by summing the currently obtained tip 312 position with the effects 

40 of the tip velocities calculated in step 22. The tip location estimation, coupled with other advantages noted above with 
regard to the algorithm of Fig. 9C, improve the efficiency of energy delivery device distal tip detection. 
[0144] The time required for the execution of software or firmware performing the individual steps of the algonthm 
of Fig 9C can be ascertained, each step requiring a specific number of CPU cycles defining a finite time period for 
execution. Therefore, while the velocity vectors of distal tip 312 are shown being added to point coordinates, in fact, 

45 these velocities and coordinates are related to a time element to allow for such calculations. 

[0145] After the estimation is made in step 24, the variable / is incremented in a step 26 and an end of sequence 
determination is then made in a step 28. If all working images of a sequence (A1 ) equals the predetermined value, the 
main loop defined by steps 14 through 28 is exited and the step 182 of Fig. 9B is deemed completed. If other working 
images are left to be analyzed, algorithm execution continues at step 14 and advances as discussed above until the 

so end of sequence determination in step 28 is true. 

[01 46] With reference to Figs. 5 A and 5B, a second embodiment of an enhanced tracking system in accordance with 
the present invention, incorporating features described above pertaining to the general embodiment, can be more 
readily understood. The second embodiment of the present invention differs from the first in that the energy delivery 
device comprises multiple radio opaque markers on or near its distal portion. All or several of the radio opaque markers 

55 A-tiare similar in size and shape and are placed a known distance from each other along the distal portion of an energy 
delivery device, as shown in Figs. 5A and 5B. 

[0147] Radio opaque markers A-D can be of any form discussed above with reference to marker 412, 512 on the 
distal tip 412, 510 of catheter 400, 500. Energy delivery device 600 can be catheter 400, catheter 500, or any other 
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energy delivery device discussed herein incorporating a plurality of markers. As with theNtrst embodiment, in this 
second embodiment fluoroscopy system 118 also acts as part of input instrument 108, providing in part, position and 
orientation information regarding the energy delivery device. 

[01 48] Since the live fluoro image would only show markers A-D, seemingly floating in space, it is desirable to rep- 
resent the position and orientation of the distal end of the energy delivery device 300 in a way that is easier to interpret 
by the User during a surgical procedure. 

[0149] Now with reference also to Fig=9A^a procedure in accordance with the second embodiment of the present 
invention will be discussed. Figs. 5A and 5B depict an energy delivery device BOO within the left ventricle of the heart, 
the outlines RAO-O and LAOO, obtained as discussed above with reference to steps 170-174, and defining the left 
[ventricle structure in a similar manner as described above. As with thernarker on the distal tip 410, 510, markers A- 
f Id are detected in steps 180-182 and combined with the working image in step 188 for display using techniques de- 
SL/*i Scribed above. Further, in the step IBBfCPUjefc' using additional interpolation algorisms, connects maj fcejS-AJU 
^Ty. resulting in a more descriptive representation of the position and orientation of the distal portion of energy delivery 

L^dev'ice 600. sj , ■ , 

is^- [0150] The CPU 102 calculating and generating the catheter orientation depiction can provide the resulting repre- 
sentation' in any suitable form. For example,' depending on the performance characteristics of the CPU 102, the distal 
portion of the energy delivery device 600 may be represented by a line which starts at the center of detected marker 
A and ends at the center of marker D, passing through the centers of markers B and C. Alternatively, the distal portion 
of the device may be represented by two lines essentially parallel and running tangentially along the detected surfaces 
20 of markers A-D, as shown in Figs. 5A and 5B. The portion of the energy delivery device 310 in dashed is representative 
of the portion where the specific orientation may be unknown. Additional markers placed along the dashed portion of 
the device would enable that portion, as well as the more distal portion, to be detected and represented in an overlaid 
working image by CPU 102. u m 

[0151] Therefore, as a result of the preferred method of Fig. 9A, while the live fluoro provides viewing of the markers 

< themselves the CPU 102, using algorithms discussed above, generates a position and orientation depiction of the 
catheter 600 and combines this depiction, as part of the working images, with live fluoro resulting in views as depicted 
in Figs 5A and 5B. Such views aid the User, and specifically the cardiologist or surgeon, in the placement of catheter , 
600 having a specific orientation within a confined area, enabling the distal tip 61 0, for example, to apply requisite force 
to target tissue during the application of a desired therapy. 
30 [0152] CPU 102, as is discussed above relative to the first embodiment, can incorporate certain User tasks such as 
the manual identification of the markers B-D abng the catheter 600 proximal from the distal tip 61 0 along with the distal 
tip 610 marker A. Such markers A-D, for example, can be automatically obtained by the CPU 102 and dynamically 
displayed as discussed above. Additionally, during a treatment event the distal marker A location can be acquired and 
stored as described above. 

35 [0153] The algorithm of Fig. 9C can be used to locate all markers A-D of the second embodiment of the energy 
delivery device, when the algorithm is used to process working images from both, RAO and LAO, views. Such analysis 
results in the fast and accurate position and orientation depiction of energy delivery device 600 within the working 
images and, ultimately within the live fluoro, as described above. 

[01 54] Additionally, it should be apparent from the foregoing that the LAO view itself can be completely generated 
40 by CPU 102 and include depictions of the distal portion of the energy delivery device, including markers A-D, and, 
optionally, the LAO outline view, when one or more of the markers A-D are asymmetric, as discussed in more detail 
below with regard to additional embodiments incorporating different sensor arrangements. Asymmetric markers allow 
for the more accurate interpretation of certain ambiguities observed when the distal tip of the energy delivery device 
is directed in an in-plane or out-of-plane direction with reference to a plane of view. Thus, the User could view one or 
45 more video displays 116, 116a comprising alive fluoro RAO view combined with the corresponding RAO view working 
image and the CPU '1 02-generated LAO view. 

[0155] With reference to Figs. 4B, 4C, and 4D, a third embodiment of an enhanced tracking system in accordance 
with the present invention, incorporating features described above pertaining to the general embodiment, can be more 
readily understood. The third embodiment of the present invention differs from the first and second embodiments in 
so that the energy delivery device comprises multiple radio opaque markers specifically designed to allow position and 
orientation information to be acquired by CPU 102 through the analysis of a single view, preferably the RAO view, 
received from the fluoroscopy system 118. ... 
[01 56] With specific reference to Fig. 4B, a distal tip 51 0 radio opaque marker 520 as used in accordance with the 
third embodiment of the present invention can be more readily understood. More specifically, Fig. 4B depicts repre- 
ss sentative views of the marker 520 as perceived by a fluoroscopy system such as system 118. 

[0157] Marker 520 is a thin-walled cylindrical marker made from similar materials as other markers described herein. 
As shown depending on the orientation of marker 520, the marker 520 appears having distinct shapes. Marker 520A 
is a representative fluoro view of marker 520 where the central axis of marker 520 is perpendicular or normal to the 
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fluoro plane. Thus, only the circjjlaj^p^earance qj tne thin wall of marker 520 is visible, providing an indication that 
the distai tip 310 of an energy delivery device 300 is either directed toward the X-rsy source, hereinafter described as 
an out-of-plane view, or away from the X-ray source, hereinafter described as an in-plane view. 
[0158] Marker 520D is shown oriented such that its central axis is parallel to the fluoro plane producing an essentially 

s rectangular image of predetermined dimensions in the live fluoro, providing an indication that the distal tip 310 of an 
energy delivery device 300 is oriented parallel to the fluoro plane view. Markers 520B and 520C are representative 
views of marker 520 at axis orientation angles between those of markers 520A and 520D, 0° and 90° respectively. 
[01 59] As the marker 520 is rotated about axis line A, its shape changes from a circular shape, as shown by marker 
520A, to an elliptical shape having various dimensions, as shown by exemplary markers 520B and 520C, to a rectan- 

io gular shape, as shown by marker 520D. Each of these shapes are distinct and, therefore, are readily and separately 
perceivable in a live fluoro video image. . 

[01 60] Now turning also to Figs. AC and 4D, utilization of marker 520 with a catheter 500A will be better understood. 
As shown in Figs. AC and 4D, an RAO view is depicted with the RAO outline image RAO-O representing the left 
ventricle. As discussed above, the RAO-O image was generated earlier prior to the procedure and incorporated or 

is combined with a live fluoro image depicting portions of a catheter. 

[0161] '. Catheter 500A is an exemplary catheter shown incorporating the marker 520 of Fig. 4B. Unlike the catheter 
500 of Fig. 4A, catheter 500A of Figs. AC and 4D comprises a laser catheter 504A different from the laser catheter 504 
of Fig. 4A, as is described in more detail below. The aligning catheter 502 may have one or more segments S defined 
by an angle formed therebetween, as shown. The laser catheter 504A, however, contains or includes a sufficient 

20 amount of radio opaque material to allow laser catheter 504A to be only partially visible in live fluoro when the catheter 
504 A is parallel to the fluoro view. 

[0162] For example, the radio opaque marker 520 is made of a material which absorbs or otherwise blocks the 
transmission of X-rays and thus appears in live fluoro as a dark area equivalent to the objects shadow produced on a 
surface when the object is held in sunlight. In contrast, laser catheter 504A contains a radio opaque substance, such 

25 as a radio opaque powder, within its main wall surface. As the orientation of the laser catheter changes, the image 
produced by the catheter 504A in live fluoro will darken or produce a change in the degree of opacification since, at 
times, more radio opaque material lies between the X-ray source and the image detector of fluoroscopy system 118. 
[0163] Additionally, laser catheter 504A may incorporate one or more symmetric or asymmetric markers 514 (not 
shown for clarity) along its distal portion at known locations and orientations with respect to each other, as well as one 

30 or more longitudinal markers 518 defining essentially planar surfaces and lying parallel to the plane of deflection of 
laser catheter 504A, to help CPU 102 better determine the position and orientation of the distal portion of catheter 
500A, as will be discussed in more detail below. Similarly, aligning catheter 502 may include one or more symmetric 
or asymmetrical markers 516 along its distal portion, at known positions with respect to each other. For example, a 
first asymmetrical marker 51 6A may be placed on a segment Sj, while a second asymmetrical marker 51 6B is placed 

35 on a segment S 2 , markers 51 6A and 51 6B defining an angle and positional orientation therebetween. 

[01 64] An example of positional orientation is found where the segment S n is placed on a first surface of the catheter 
502 while the segment S2 is placed on an opposing surface. Alternatively, a marker 51 6C may be placed on aligning 
catheter 502 extending along two or more sections S providing another known orientation from which CPU 102 can 
analyze. These known marker placement positions and orientations, as well as other components of catheter 500A 

40 comprising variable amounts of radio opaque material resulting in differing degrees of opacification based on orienta- 
tion, as stated above, aid the CPU 102 in generating out-of-plane images as is more fully discussed below. 
[01 65] Also shown in Figs. 4C and 4D are exemplary views of the clock face output As discussed above, the clock 
face graphical output generated by CPU 102 provides the User with an indication of catheter 500A distal tip 510 ori- 
entation with respect to a different view, an LAO view for example. Thus, referring specifically to Fig. 4C, the catheter 

45 50OA is shown with the distal tip 510 pointed toward the inferior surface of the left ventricle as depicted by RAOO. 
Marker 520 is shown with the rectangular shape of marker 520D providing an indication that the distal tip 510 lies 
parallel to the fluoro plane, i. e., is not rotated in-plane or out-of-plane. The corresponding viewf rom the LAO perspective 
would show the distal tip 510 forming a 0° angle with the fluoro plane and thus be pointing towards the inferior surface 
of the left ventricle. 

50 [0166] In contrast, referring specifically to Fig. 4D, catheter 500A is shown with the laser catheter 504A rotated such 
that the distal tip 510 is pointing either in-plane or out-of-plane with respect to the fluoro plane. As will be discussed in 
greater detail below, without analysis of the catheter components, including for example, the marker 520 having an 
orientation similar to marker 520D, it is hard to distinguish which direction the catheter tip 510 is pointing,' in-plane vs. 
out-of-plane. Here, the distal tip 510 is pointing in-plane and thus the clock face image, which generally depicts the 

55 LAO view, indicates the distal tip 510 pointing more to the lateral wall of the heart. 

[0167] Given the structure of catheter 500A and with reference also to Figs 9A-D, a preferred procedure involving 
the third embodiment of the present invention can be better understood. As stated above, it is desirable to calculate 
_ the position and orientation of energy delivery devices within a body during a surgical procedure incorporating a fluor- 
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oscopy system 118 having a single-plane fluoroscope and where it is undesirable to rotate the fluoroscope to obtain 
a second view, an LAO view for example, reducing the time of the procedure and exposure to X-ray rad.at.on , during 
the procedure. The preferred method involving the third embodiment of the present invention builds upon or otherw.se 
adds to the preferred method of Fig. 9A. ... , K i. D «n „•■<,„. th» 

s r0168l When only a single-plane fluoroscope 110 is utilized producing a s.ngle v.ew. preferably an RAO v.ew the 
distal tip orientation is analyzed and provides position and orientation information with respect to another view an LAO 
view for example. With relerence to Fig. 9B. the distal tip marker 312 orientation must be detected in a step 184 as 
part dstep 182. Once theorientation of the nwk^ 

into in-plane or outof-plane coordinates is performed in a step 1 86. ^ part of step 182. The orientation d the ^ 

10 312 is determined by the sub-algorithm of Fig. 9D, the sub-algorithm being a further definrtion of step 18 of the mam 
Algorithm of Fig. 9C. It is important to note that with other input instruments 108 being utilized a port.on or all of the 
data corresponding to data acquired during execution of steps 1 84 and 186 may be^royided 1o-the^telaacqu.srt.on 
svstem of GPU 102 For example, a specific input instrument 108 may provide sensor orientations but not provide 
^fhese orientations with reference to other data acquired by CPU 102. The CPU 102 would then correlate the sensor 

75 data to the other data acquired, providing the coordinates per step 1 86. . 

r01691 Now With specific reference to Figs. 9C and 9D, the steps which make up a distal portion marker locaton 
algorithm incorporating tip orientation information, depicted as step 18 of Fig. 9C. can be more fully understood The 
distal portion marker location algorithm generally functions by comparing one or more stored images of the distal tip 
310 of the catheter 300 to the current sub-image f m as part of the current working image. The stored subimages are 

20 termed kernels, each kernel represent 

r0170l In a first step 18.0 a variable N k \s set to the number of kernels which will be considered dunng execution of 
the distal portion marker location sub-algorithm. The greater the number of kernels provided results in a more accurate 
determination of the marker orientation. In a second step the kernel counter/, defining the current kernel bemg con- 
sidered, is initialized to zero. ...... ^,^ iri „ 

25 r01711 In a step 18.4. the first step of a mam loop of the sub-algorithm, a Mean-Squared-Difference (MSD) matching 
fitter is used to compare the sub-image f m of step 16 with the current kernel, defined as h(j). The MSD filter itself is 
defined as: 



35 Where: 



40 



h(k,l) = Value of the current kernel at pixel location (k,l); 
L = Length of the kernel in pixels; and 
K = Width of the kernel in pixels. 

f0172] The output of the MSD fitter produces a small value when the sub-image f m and the current kernel, of the 
stored kernels, is found to be very similar. With increasing similarity between the current kernel and the sub-rmage f m 
the MDS output approaches a value of zero. ■ . . 

[0173] TheimageZisthensettothereciprocalofth^^ 
as when the sub-image of the working image and the current kernel are nearly identical. In a step 1 8.8. the image Z is 
then multiplied by atwo<limensional Gaussian function, Gg* that obtains its maximum at the center of Z & the expected 
catheter tip 310 location. Multiplying the image Z by in the step 18.8. gives more weight to peaks that are close 
to the expected catheter tip 310 location. , ' 

r01 741 The value and location of the maximum of Zq are found and stored m a step 1 B.1 0. In a step 1 8.12 the kernel 
so counter variable, / is incremented. Next, if the kernel counter variable is found to be less than the number of stored 
kernels. i.e., all the kernels have not been compared with the current sub-image, transfer is passed back to step 18.4. 
in a step 18.14. and execution of the sub-algorithm continues as discussed above. 

[01751 If all the stored kernels have been considered then the tip 310 location is then determined in a step 1 816. 
The catheter tip 310 is located at the point corresponding to the maximum of Z G of all the maxima. The coordinates. 
55 associated with pixel coordinates (k,l) of the kernel which most closely matches the sub-image, as well as orientation 
information, i.e., the orientation of the kernel which most closely matches the sub-image, is provided to step 20 of the 
main algorithm of Fig. 9C in a final step 18. 18. 

[0176] Therefore, by analyzing the specific shape of the distal tip marker 312. CPU 102 can estimate the position 



18 



2/14/2007, EAST Version: 2.1.0.14 



EP 1 057 455 A2 



and orientation of the distal tip 310 of the energy delivery device 300 and provide one or more outputs, such as the 
clock face depiction, as discussed above. The CPU 102 can discern in-plane rotational movement from out-of-plane 
movement by referencing rotational motion of the laser catheter, the aligning catheter, and translational motion of the 
fiber optic or fiber bundle 508 with respect to the distal tip 310. The rotational movement of the catheters 502. 504A 
and the translational motion of the fiber optic 508 can be measured in any convenient manner, for example through 
the use of rotation encoder systems or potentiometers. Signals representative of signals provided by these measure- 
ment devices are then provided to the data acquisition system of CPU 102 for acquisition, interpretation and integration 
into one or more working image in accordance with embodiments of the present invention. Optionally, in-plane and 
out-of-plane motion can be distinguished by the User providing an additional input to CPU 102. such as a keyboard 
input V for describing the distal tip,31 0 directed laterally and input "S" for describing the distal tip 31 0 directed septally. 
[0177] With respect to the catheter 500A of Figs. 4C and 4D, the algorithms of Figs. 9A-D may be utilized in a similar 
fashion in orderto interpret orientations of markers 51 6 and 51 8 on the aligning catheter and laser catheter, respectively, 
allowing the CPU 102 to more accurately define output depictions. For example, starting from a known orientation such 
as the orientation depicted in Fig. 4C, the CPU 1 02 in accordance with methods described herein can associate move- 
ments of the marker 518. which is placed on side wall of the laser catheter, to indicate rotation of 1he laser catheter 
504A. Additionally since the curvature of the laser catheter 504A is known or predetermined, the degree of foreshort- 
ening of the distal portion of the laser catheter 504A. represented by X and Y measurements, of the distal portion of 
the laser catheter 504A observed will then define an angle of rotation. The X and Y measurements can be acquired 
by the CPU 102 in accordance with the present invention and utilized in the generation of one or more outputs, such 
as the clock face outputs as shown in Figs. 4C and 4D. and discussed above. 

[0178] Additionally, the amount of rotation of the distal tip of laser catheter 504A can be enhanced by embedding a 
radio opaque filler material, such as barium sulfate or bismuth subcarbonate, typically between 1 0% and 40% loaded 
by weight into the distal tip such that an image of varying opacity will be observed in the live fluoro when the distal tip 
is rotated from an in-plane position to an out-of-plane position with respect to an RAO view. The minimum opacification 
being perceived when the distal tip of the catheter 504A is directed parallel to the RAO view and the maximum opaci- 
fication being perceived when the distal tip of the catheter 504A is directed either in-plane or out-of-plane with respect 

r0179]^The analysis of markers 516 and 518 may be made in addition to acquisition of rotational and translational 
movements of the catheters 502, 504A and fiber optic 508, respectively, to more accurately define the current position 
and orientation of the catheter 500A. 

[0180] With reference to Figs. 4E-5H, a fourth embodiment of an enhanced tracking system in accordance with the 
present invention, incorporating features described above pertaining to the general embodiment, can be more readily 
understood The fourth embodiment of the present invention differs from the third embodiment in that the energy delivery 
device comprises multiple radio opaque markers of similar size and shape and arranged on the energy delivery device 
a known distance between each marker specifically designed to allow position and orientation information to be ac- 
quired by CPU 102 through the analysis of a single view, preferably the RAO view, received from the fluoroscopy 
system 118. This embodiment is particularly useful when a tifxieflectable energy delivery device, such as catheter 
400. is utilized during a surgical procedure. 

[0181] It should be apparent that while the markers are shown to be equidistant from each other, the markers only 
need be placed defining a known relationship between each marker. Additionally, the markers are shown to be of similar 
size and shape, but may also be implemented such that one or more markers are asymmetric to assist CPU 102 m 
more accurately resolving certain in-plane and out-of-plane ambiguities. With specific reference to Fig. 4E. the catheter 
400 is shown having multiple thin-walled markers 414 on a distal portion 416. As is better shown in Fig. 4G. as the 
catheter 400 distal portion 41 6 is deflected by the deflection mechanism such that the distal tip 41 0 moves either out- 
of-plane or in-plane with reference to a specific view, the RAO view for example, the maikers 414 indicate the movement 
in a similar fashion as marker 520, the distal portion 416 having the greatest deflection is shown producing a fluoro 
image closer to a circle. Since the markers 414 closer to the main shaft 402 appear as thin rectangular portions and 
the markers 414 closer to the tip 410 appear having an ellipticity, the distal tip 410 must be deflected either in-plane 
or out-of-plane from the main shaft 402. 

[0182] In contrast, as shown in Fig. 4F, when the deflection of the distal portion 416 is essentially along the plane of 
view only the most distal marker 41 4 indicates a slight ellipticity. Therefore, the deflected distal tip 41 0 of catheter 400 
is deflected in a plane roughly parallel to the plane of view. 

[0183] Since the markers of catheter 400 are.part of the deflectable distal tip portion 416, while the distal portion 416 
deflects the wall portions of the distal portion 416 define an inner and outer bend radius along the plane of deflection. 
Therefore, the spacing between the markers 414 changes when the distal portion is deflected, the portions of the 
markers 41 4 essentially lying along the outer bend radius being af urther distance apart than the portions of the markers 
414 essentially lying along the inner bend radius. For example, with reference to Fig. 4G, a point A of a first marker 
414 is shown as part of the outer bend radius of deflection and a point C is shown as part of the inner bend radius of 
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deflection Additionally, a second marker 414 comprises a point B and a point D as part ot the outer bend and inner 
bend radius of deflection, respectively. Therefore, when the distal portion 416 of catheter 400 is deflected as shown, 
the distance between the points A and B is greater than the distance between points C and D provid.ng the conclusion 
that the distal portion 41 6 is deflected essentially in-plane. 

[01 84] As discussed in greater detail above with reference to Figs. 9A-D, the algorithms of Figs. 9A-D can be used 
to determine the position and orientation of Ihe distal portion 416 of catheter 400 by specifically determining the orien- 
tation of distal tip 410 marker 412, and then analyzing the circumferential spatial relationship of the markers 414 as 
between each other, the largest distances observed between different markers 414 defining the outer bend radius of 
deflection and, thus, defining the orientation of the distal portion 41 6. ... 
[01 85] Now with reference to Fig. 4H an alternative catheter 400A is shown. The catheter 400A of Fig. 4H, l|ke the 
catheters 400 of Figs. 4E-4G. is adapted to have multiple markers 41 4A arranged in a known relationship to each other 
along the distal portion 416. However, the markers 414A as shown, are similar in size and shape to marker 412. 
Therefore only one marker need be defined by the User prior to execution of the algorithms of Figs. 9A-D and the 
algorithms of Figs. 9A-D determining the orientations of each marker 41 4A, without regard to bend radius, each marker 
41 4Athen specifically defining the position and orientation of the energy delivery device at its location along the distal 

10186? Optionally, catheter 400A can comprise another radio opaque marker 414B. essentially rectangular in shape, 
acting as a bridge between the two most proximal markers 414A, as shown in Fig. 4H. This ■|-beanV marker 414A/ 
41 4B configuration, which is defined in more detail in the Rosenthal reference, provides additional information from 
which CPU 1 02 can calculate in-plane and out-of-plane projects of the distal portion 41 6 of the energy delivery device. 
[0187] More specifically, marker 41 4B is placed on the catheter 400A essentially parallel to the plane of deflection 
of the catheter 400A Thus, when the catheter distal tip 410 is directed in-plane, the marker 41 4B will appear as a thin 
line along a first side portion of the catheter distal portion 41 6 between the two most proximal markers 41 4A In contrast, 
when the distal tip 410 is directed out-of-plane, the marker 414B will appear as a thin line along a second side portion 
appearing in opposition to the first side portion. . 
[0188] Therefore, the CPU 102, analyzing a current working frame as part of methods in accordance with the present 
invention can utilize the marker 41 4B to better define and describe the position of the distal portion 41 6, including Ihe 
distal tip 41 0, when combined with a live fluoro view, generating the combined image as one of several outputs based 
on a single planar view, such as an RAO view. 

[0189] With reference also to Fig. 9E. an additional method for calculating the position and orientation of the energy 
delivery device 300, performed as part of step 18 of Fig. 9C, can be better understood, ft is assumed prior to performing 
the steps of Fig 9E that the individual position and orientation of markers 41 4A of catheter 400A have been determined 
by performing the steps of Fig. 9D lor each individual marker 414A The outcome of the steps of Fig.9E provides or 
describes the position and orientation of the distal marker in terms of yaw, roll, and pitch relative to a coordinate system 
defined by CPU 102, as is described in more detail below. The-relerence-poinVfor example, can be provided by the 
fluoroscope planar view, preferably an RAO view, where the vertical axis of the RAO perspective is x, the horizontal 
axis of the RAO perspective is y, and the positive z direction is defined as moving in-plane with respect to the x-y plane, 
as shown if Fig. 4H. 

[0190] In an initial step 18.20 the individual markers are provided with working identification numbers (IDs) or other 
descriptive information from which to distinguish one marker 414A from another marker 414A For the purposes of 
discussion the markers are provided ID numbers ID1-ID5, ID1 given to the most proximal marker 414A and ID5 given 
to the most distal marker 41 4A, as shown in Fig. 4H. 

[0191] It is important to note that the method of Fig. 9E minimally requires three markers 41 4A, however, the place- 
ment of additional markers 414A along the catheter 400A, along with corresponding analysis in accordance with other 
methods of the present invention, provide for a more accurate determination of position and orientation of the distal 
portion of the catheter 400A 

[01 92] In a step 1 8 22 a best fit line using a least squares approach is determined through the more proximal matters 
41 4A of Ihe longitudinal shaft of 1he catheter 400A, represented here by markers 41 4A having IDs ID1-ID3. The best 

fit fine shown as line V. ' 
[0193] ■ In a step 18 24. the line L is compared with the y-z planar surface, the angle formed therebetween defining 
a yaw orientation of the catheter 400A Next, in a step 18.26 a line D perpendicular to the line L and passing through 
the distal marker 414A having iD5 is then generated, and the distance d e representing the length of Ime D with respect 
to the current perspective view is computed. With the distal portion 41 6 of catheter 400A having a predetermined shape, 
the maximum value of d„ which is known or otherwise can be calculated during a calibration process, will be observed 
when the deflection plane of the catheter 400A is parallel to the plane of view. As the catheter 400A is rotated about 
the longitudinal axis of Its main shaft, shown as line L. the distance d, measured will decrease. The roll angle can then 
be measured by the equation: 
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Rotl = 90° -Cos' 1 



9C 



Where: cL«i is the maximum value of dp . . . A#>1 ... f . fl 

mm MS a ste" 18.30, the distance d s between two or more markers 414A along line L « determmed As wrth the 
measurement d above, since the orientation and placement of markers 414A along the longitudinal axis of the -catheter 
^A a7^^dfetance between these markers when the longitudinal axis is parallel to the perspective pfcne 
^so Sown. Pilch, defined as the angle formed by line Land the x-yplanar surlace. B then measured^ a step 18.32 
by computation of the equation: 



Pitch = Cos' 



^r^™^^^ step 18 of Fig. 90, the yaw. ro,L and £J ^"^9 
Sized by CPU ?02 to more accurate* define the position and orientation of catheter 400A. As shown in F,g. 4H 
Seter 400A may include a bridge radio opaque member 414B between the two most proximal markers 414A and 
SSeTelseSr herein, to help CPU 102 better determine in-plane and out-ol-plane orientals of the distal 
^^tSSSX - ^u.d be clear that the steps of Fig. 4H. whi.e described in terms of catheter 400A are 
SSble to the analysis of any energy delivery device comprising at least three radio opaque markers arranged at 
Sow?o5eSation J respect to each other such as markers 414A having IDs ID1 ID2. and IDS. The markers may 
be of any suitable shape allowing for the calculations described above with respect to Fig. 9E 
r0196rwith the yaw roll, and pitch angles computed for the catheter 400A with reference to the ongin o a three- 
SSL oToc^e system.CPU to! can then merge this data with other data acquired * the > ^«°£0 
image. The working image can then be combined wrth the b. fluoro view and provided as ™«£°^J*°£ 
102 It should be understood that, while the actual measurements are made in terms of pixels of an mage, since the 
resolution of the image is known, the measurements can be defined in terms of other units of length 

AddWonally 'if It is desired, the dtetance the energy delivery device or other item incorporatog iad.o opaque 
Sal teSm*. X-ray source, not shown, can be calculated in an additional step (not shown). The equation that 
describes the relationship between an object's size and its imaged size in the fluoroscope system is: 



u=x[D/(D-Z)) 



Where: 



D is the source-to-detector distance; 
z is the object-to-detector distance; 
x is the object size; and 
u is the imaged size. 



r0198l It is important to understand that relative position and orientation information regarding energy delivery de- 
Stees depictions of the heart, and other items utilized during a surgical procedure as descnbed herein in accontence 
2Tt?££ Mention, can be associated by way of additional analysis For example, the l^rp^ 
while being generally described with respect to RAO and LAO views, may also have other angular components, m- 

SSS l£F££^c**nW the use of delectable and shaped energy delivery devices having or 
Sing sections of increased or decreased radio opacity, when used in accordance with the present ■nventin wHI 
Sefor enhanced visualization, recognition and control of the energy del-very dev.ce during the surgcal procedure. 
t£T!£ ST? S a catheter, for example, is rotated towards the septal or lateral walls while being vewed from an 
^O pTrapecthre it will be understood that the physical amount of material present between the X-ray source and the 
Inage detector of the fluoroscope will be increase and a fluoroscopic image thereof will appear increasingly opaque. 
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i.e., the change in opacity can be correlated with the degree of rotation as well as the position of the tip and other 

[aToO] S With reterence to Fig. 41 a representative RAO and LAO projection view of the distal end 710 of an energy 
delivery device 700, having a radio opaque marker 712 similar to marker 31 2, in the left ventricle with a set of radially 

s asymmetrically spaced radio opaque markers 718 is shown being deflected toward the lateral surface of the heart. In 
similar fashion, Fig. 4J is a representative RAO and LAO view depicting the distal portion being deflected toward the 
septal surface of the heart. As described above, with the distal portion of the energy delivery device 700 oriented as 
shown in Figs 41 and 4J, the distal tip marker 71 2 appears as a circle in the live fluoro. Note that a portion of the marker 
712 in Fig. 41 is shown in dashed only to provide a clearer understanding that the distal portion of energy delivery 

70 device 700 is directed toward the lateral surface of the heart 

[0201] The markers 718 are thin stripe-type markers having centers located approximately 90° radially from the 
direction of tip deflection, the inner bend radius as defined above for example. Therefore, the deflection of the distal 
portion of energy delivery device 700 insane and out-of-plane with respect to the RAO view can be distinguished. 
[0202] As depicted in the RAO view of Fig. 4l f it can be determined that the energy delivery device is shown deflected 

is toward the lateral surface of the left ventricle since the markers 71 8 are viewed on the top surface of the energy delivery 
device' depiction. In contrast, in the RAOview of Fig. 4J, the distal portion of the energy delivery device is deflected 
toward the septal surface since the markers 718 are viewed on the bottom surface of the energy delivery device de- 
piction providing an indication that the energy delivery device has been rotated 180°. 

[0203] Therefore, using methods of the present invention, CPU 102 can analyze the distal tip marker 712 along with 
20 the markers 71 8 of the RAO depictions of Figs. 41 and 4J, and from these views determine the position and orientation 
of the distal portion 71 6 of energy delivery device 700. 

[0204] With reference back to Fig. 1 , a fifth embodiment of an enhanced tracking system in accordance with the 
present invention, incorporating features described above pertaining to the general embodiment, can be more readily 
understood. The fifth embodiment of the present invention differs from the other embodiments in that the input mstru- 
25 ment incorporates a localized location and orientation system utilizing magnetic sensors arranged on the distal portion 
of an energy delivery device. Such a system, by way of example, is disclosed in U.S. Patent 5,879,297 to Haynor et 
al. (hereinafter Haynor), entitled 'System and Method to Determine the Location and Orientation of an Indwelling Med- 
ical Device.' 

[0205] The system of Haynor comprises a housing and, using magnetic field analysis, can provide an output de- 
30 scripfrve of the location of the energy delivery device with respect to the housing. This output would then be provided 
to the CPU 1 02 of the present invention and, along with other data acquired, merged with one or more working image 
and combined with other information to generate one or more output, as discussed in more detail above, "me output 
provided to CPU 102 could comprise, for example, a video signal providing depicting the current distal tip position and 
relative treatment site locations. Alternatively, the provided output could comprise binary data descriptive of the relative 
3S positions of the distal tip position of the energy delivery device and treatment site locations. In both cases, however, 
the output would be referenced to a three-dimensional origin relative to the housing of the Haynor device. 
[0206] CPU 1 02. in order to generate one or more output, must be able to correlate the data received from the Haynor 
system with other data acquired and integrated into the current working images. This may be achieved by placing 
additional magnetic sensors at know relationships with respect to other objects or sensors from which CPU 1 02 acquires 
40 data. For example, magnetic sensors could be arranged at the center of the motion markers described above. Addi- 
tionally the single radio opaque marker on the distal tip of the energy delivery device at a known relationship with 
respect to the magnetic sensors placed thereon can provide a suitable data reference. Both of the above examples 
provide CPU 102 a reference point from which output data received from the Haynor system can be correlated to other 
data obtained data. 

45 [0207] At this point it should be appreciated that with increased computing power there will exist a corresponding 
increase in complexity with respect to the output depictions of the present invention. For example, the three dimensional 
output depiction described above could be an actual generated depiction of the heart itself. The heart being able to be 
rotated and otherwise manipulated to depict the position and orientation of an energy delivery device therein. 
[0208] While the principles of the invention have been made clear in illustrative embodiments, there will be immedi- 

so ately obvious to those skilled in the art many modifications of structure, arrangement, proportions, the elements, ma- 
terials, and components used in the practice of the invention, and otherwise, which are particularly adapted to specific 
environments and operative requirements without departing from those principles. The appended claims are intended 
to cover and embrace any and all such modifications, with the limits only of the true purview, spirit and scope of the 
invention. 

55 
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Claims 

1. A method tor tracking a surgical device in a live fluoro view during a surgical procedure comprising the steps of: 
a) Generating at least one working image from a live fluoro video signal corresponding to a first of at least one 

wShVtady systems data, the body system data being registered with the at least one working image; 

c) Detecting at least one event from which additional data related to the surgical procedure is acquired, the 
additional data being merged into the at least one working image; 

d) Combining the generated at least one working image with the live fluoro video signal and forming a first ot 
a plurality of outputs, the first output being a video signal; and - 

e) Providing the first output to a display system wherein the first output can be depicted on at least one video 

display. 

2 The method of claim 1 wherein the step of combining the generated at least one working image Witt, the live fluoro 
videc^igna. comprises the step of storing'the at least one working image, wherein the stored data provides a 
histology otthe surgical procedure. 

3. The method of claim 1 wherein the step of generating at least one working image from a I** Auoro< video signal 
comprises the step ot digitizing a video frame as part of the live fluoro video signal representative of the first of the 
at least one perspective view. 

4 The step of claim 2 wherein a first of the at least one event is a motion marker detection event, data obtained in 
the step of detecting at least one event comprises position and orientation information with respect to at least one 
motion marker, the at least one working image being oriented with the live fluoro video signal. 

5 The step of claim 4 wherein a second of the at least one event is a ventriculogram event, data obtained in the step 
of detecting at least one event further comprises data representative of at least one outline view corresponding to 
the first of the at least one perspective view, the at least one outline view being stored. 

6 The step of claim 5 wherein a third of the at least one event is an surgical device detection event the step of 
' detecting at least one event further comprising the step of acquiring the position of the distal port™ of the surgical 

device, data obtained in the step of detecting at least one event further comprises position data of the distal portion 
of the surgical device. 

7 The step of claim 6 wherein a fourth of the at least one event is a treatment event, data obtained in the step of 
' detecting at least one event further comprises position data of the distal portion of the surgical device dunng the 

application of a desired therapy. 

The method of claim 5 further comprising a first and a second of the at least one outline views, the first of at least 
one outline view being a right anterior oblique-30- view and a second of at least one outline view being a left 
anterior oblique-60* view. 

The method of claim 8 wherein the step of acquiring the position of the distal portion of the surgical device further 
comprises the steps of: 

a) Defining a sequence of images comprising at least two working images depicting a specific perspective 

b^Obtebin^ representative ot the position ot the distal portion of the surgical device within the 

crSracSg^slSage from the current working image, the subimage being a predetermined distance from 

^D^tinfthe distal portion of the surgical device within the subimage. wherein a new coordinate defining 
a central portion of the distal portion of the surgical device is defined with respect to the current working image; 
e) Estimating the position of the distal portion of the surgical device in a next working image as part of the 

sequence of images; and • 
0 Repeating steps c through e until all the images of the sequence have been considered, the next working 

image becoming the current working image. 



8. 



9. 
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10. The method of claim 9 wherein the step of detecting the distal portion of the surgical device with the subimage 
comprises an initial step of filtering the subimage. 

11. The method of claim 10 wherein the step of estimating the position of the distal portion of the surgical device 
5 comprises the step of calculating velocity vectors representative of the distal portion of the surgical device. 

12. The method of claim 11 wherein the step of detecting the distal portion of the surgical device within the subimage 
further comprises the step of comparing the subimage with at least one known depiction of the distal portion of 
the surgical device. 

10 

*1 3. The method of claim 1 2 wherein the step of detecting the distal portion of the surgical device within the subimage 
further comprises the final step of storing the coordinate. 

1 4. The method of claim 1 3 wherein the step of acquiring position data of the distal portion of the surgical device further 
is comprises the steps of: 

a) Detecting the orientation of the distal portiorr of the surgical device; and 

b) Translating the orientation into out-of-plane or in-plane coordinates representative of the distal portion of 
the surgical device. 

20 

15. The method of claim 1 4 wherein the step of comparing the subimage with at least one known depiction of the distal 
portion of the surgical device comprises the steps of: 

a) Defining at least two depictions of the distal portion of the surgical device, a current depiction defined by a 
25 first of the at least two depictions; 

b) Initializing an output variable corresponding to a selected depiction to zero; 

c) Applying a mean-square-difference filter to the subimage and the current depiction; 

d) Determining the orientation of the distal portion of the surgical device; and 

e) Repeating steps b through c until ail depictions have been considered, the output value being descriptive 
30 of the position of the distal portion of the surgical device. 

1 6. The method of claim 1 5 wherein the mean-square-difference filter is defined as: 



40 

Where: 

h(Kt) = Value of the current depiction at pixel location (k,l); 
L = Length of the depiction in pixels; and 
45 K = Width of the depiction in pixels. 

17. The method of claim 15 wherein the step of determining the orientation of the distal portion of the surgical device 
comprises the steps of: 

so a) Calculating a reciprocal value of the result obtained from the application of the mean-square-filter; 

b) Calculating a degree of similarity value descriptive of the degree of similarity between the subimage and 
the current depiction by applying a two-dimensional Gaussian function to the reciprocal value; and 

c) Setting the output variable to the degree of similarity value if the degree of similarity value is larger than the 
output variable. 

55 

18. The method of claim 17 wherein the step of determining the orientation of the distal portion of the surgical device 
comprises the steps of : 
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a s Calculating an equation of a first line, using a mathematical method, the line passing through at least two 
iSSSSZZ!.^ are posted on the longitudinal axis of the surgical device, the fust hne. when 
L^oaTed to a first planar surface defined by two axes of a coordinate system, defining a first angle, 
b) Jf-JSE. of a second Hne.Using a mathematical method, the second line being tengenfi* 
to me mZ and passing through a radio opaque marker on the distal tip of the surgcal device the length 
S £ l^SSSZ representative of an a^ol^^ft.lBn*u«rtJ1h.^d« 
c SSg a distance between the at least two radio opaque markers which are P"»^*£B£ 
d na^axis of the surgical device, the distance being representative of a second angle formed between the 
£S*mZ «L surgical device and a second planar surface defined by two axes of the coord,nate 
system, the second planar surface being orthogonal to the first planar surface. 

19. An enhanced surgical device tracking system comprising: 

VSSSSSS^ <*>w™9 at ,east °" e sensor in combinalton ^ a surgical device ; * e at ,east 

oneTpuTin^lnt operabfy interfaced with the centra, processing unit and providing the central processmg 
unit raw data descriptive of the relative position and orientation ol the surgical device; 
aneST^inpuTdevice operab* interfaced with the centra, processing unit, the at least one input device 
o oSaTe central processing unit additional data descriptive of a surgical procedure being performed, the 
£££££ Tun" being L to generate at .east one working image corresponding to a specfic per- 
snective view from the raw data and additional data acquired; and 

TZSSS^m operabV interfaced with the centra, processing un« and adapted to accept and d.sptey 
ItaSm output signal Ifrom the central processing ^aflmldthealleartweoulputs^^nga^BO 
sSwrnprising the at least one workinginiagevritha.ivefluorovideosignal of thesame specie perspectn,e 

view. 

20. A method for tracking a surgical device in a live fluoro view during a percutaneous transluminal myocardial revas- 
cularization procedure comprising the steps of: 

a) Acquiring data descriptive of the position and orientation of the surgical device from one or more input 
instruments and one or more input devices; 

b) Processing the acquired data; and 

c) Generating at least one output from the processed data. 

21. A computer program product for tracking a surgical device during a surgical procedure, the computer program 
product comprising: 

a computer usable medium having computer readable program code embodied in the medium tor use in a 
coSerbasurgical device tracking system, the surgical device tracking system including a centra, process- 
inTu P ntaT.east one input fcstrument comprising at least one sensorin combinahon <^^*"» 
»erablv interfaced with and providing the central processing unit raw data descriptive of Hie relative posrton 
3 onen a S of the surgicaldevice during the surgteal procedure being performed, at least one .nput device 
SrabrSaced with and providing the central processing unit additional data desenptwe of the surg.caJ 
P^ure Sg performed, and a video display system operab* interfaced with the central processing unrt 
aSadaUd to accept and display at least one output signal from the central processing unit, the program 

fi^coTStTtcauses the central processing unit to receive input from the at least one input instroment; 
se^code that causes the central processing unit to receive input from the at least one input device. 

from the at least one input instrument and the at least one input device; 

£Z ScTses the centra, processing unit to combine the generated working image wrth a hve fluoro 

Tc2Z£^£SZi S unit to de.fcer the coined signal to the video disp^y system 
r d SayTng "e -^bined signals a first of the at .east one output signa. from the centra, processmg unrt 
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